Jul 31 10:44:03 devstack cinder-volume[77879]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 10:44:03 devstack cinder-volume[77879]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 10:44:03 devstack cinder-volume[77879]: we strongly recommend against using it for new projects. Jul 31 10:44:03 devstack cinder-volume[77879]: If you are already using Eventlet, we recommend migrating to a different Jul 31 10:44:03 devstack cinder-volume[77879]: framework. For more detail see Jul 31 10:44:03 devstack cinder-volume[77879]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 10:44:03 devstack cinder-volume[77879]: import eventlet # noqa Jul 31 10:44:06 devstack cinder-volume[77879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:44:06 devstack cinder-volume[77879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:44:06 devstack cinder-volume[77879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:44:07 devstack cinder-volume[77879]: INFO dbcounter [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Registered counter for database cinder Jul 31 10:44:07 devstack cinder-volume[77879]: DEBUG oslo_db.sqlalchemy.engines [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77879) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:44:07 devstack cinder-volume[77879]: DEBUG dbcounter [-] [77879] Writer thread running {{(pid=77879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:44:07 devstack cinder-volume[77879]: INFO cinder.rpc [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 10:44:07 devstack cinder-volume[77879]: INFO cinder.rpc [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 10:44:07 devstack cinder-volume[77879]: DEBUG oslo_db.sqlalchemy.engines [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77879) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:44:07 devstack cinder-volume[77879]: INFO cinder.volume.manager [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Determined volume DB was empty at startup. Jul 31 10:44:07 devstack cinder-volume[77879]: DEBUG cinder.volume.manager [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77879) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 10:44:07 devstack cinder-volume[77879]: INFO cinder.volume.manager [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 31 10:44:07 devstack cinder-volume[77879]: WARNING stevedore.named [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 10:44:07 devstack cinder-volume[77879]: WARNING castellan.key_manager [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:44:07 devstack cinder-volume[77879]: WARNING cinder.keymgr.conf_key_mgr [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:44:07 devstack cinder-volume[77879]: DEBUG cinder.volume.drivers.lvm [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77879) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 31 10:44:07 devstack cinder-volume[77879]: DEBUG oslo_concurrency.processutils [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_concurrency.processutils [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.424s {{(pid=77879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_db.sqlalchemy.engines [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77879) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:44:08 devstack cinder-volume[77879]: INFO cinder.rpc [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 31 10:44:08 devstack cinder-volume[77879]: INFO cinder.rpc [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 31 10:44:08 devstack cinder-volume[77879]: WARNING stevedore.named [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 10:44:08 devstack cinder-volume[77879]: WARNING castellan.key_manager [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:44:08 devstack cinder-volume[77879]: INFO cinder.volume.manager [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_db.sqlalchemy.engines [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77879) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:44:08 devstack cinder-volume[77879]: INFO oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Starting 1 workers Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Started child 78033 {{(pid=77879) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Full set of CONF: {{(pid=77879) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] ******************************************************************************** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Configuration options gathered from: {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] ================================================================================ {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] allow_availability_zone_fallback = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] allow_compression_on_image_upload = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] allowed_direct_url_schemes = [] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] api_rate_limit = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] auth_strategy = keystone {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] az_cache_duration = 3600 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_availability_zone = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_host = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_name = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_stats_polling_interval = 60 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backup_api_class = cinder.backup.api.API {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backup_name_template = backup-%s {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backup_use_same_host = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backup_use_temp_snapshot = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] chap_password = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[78033]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] chap_username = {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cinder_internal_tenant_project_id = bb2527ce35b74208bfdd600f5055253d {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cinder_internal_tenant_user_id = 50bc310f4d5342ca9bf82e8c0d65e776 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cloned_volume_same_az = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cluster = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] compression_format = gzip {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] compute_api_class = cinder.compute.nova.API {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] config_dir = [] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] config_source = [] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] control_exchange = openstack {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] debug = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] default_availability_zone = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] default_group_type = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] default_volume_type = lvmdriver-1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] disk_geometry = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] driver_client_cert = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] driver_client_cert_key = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] driver_data_namespace = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] driver_ssl_cert_path = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] driver_ssl_cert_verify = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] driver_use_ssl = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] enable_force_upload = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] enable_new_services = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] enable_unsupported_driver = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] enforce_multipath_for_image_xfer = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] filter_function = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance_api_insecure = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance_api_ssl_compression = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance_ca_certificates_file = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance_catalog_info = image:glance:publicURL {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance_certfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance_keyfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance_num_retries = 3 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance_request_timeout = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] goodness_function = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] graceful_shutdown_timeout = 5 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] group_api_class = cinder.group.api.API {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] host = devstack {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] image_compress_on_upload = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] image_conversion_address_space_limit = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] image_conversion_cpu_limit = 60 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] image_conversion_disable = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] image_upload_use_cinder_backend = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] image_upload_use_internal_tenant = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] image_volume_cache_enabled = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] image_volume_cache_max_count = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] image_volume_cache_max_size_gb = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] init_host_max_objects_retrieval = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] instance_format = [instance: %(uuid)s] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] iscsi_target_flags = {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] iscsi_write_cache = on {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] iser_helper = tgtadm {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] iser_ip_address = 192.168.122.235 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] iser_port = 3260 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] log_color = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] log_config_append = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] log_dir = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] log_file = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] log_options = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] log_rotate_interval = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] log_rotate_interval_type = days {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] log_rotation_type = none {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] max_age = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] max_logfile_count = 30 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] max_logfile_size_mb = 200 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] max_over_subscription_ratio = 20.0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] message_reap_interval = 86400 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] message_ttl = 2592000 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] migration_create_volume_timeout_secs = 300 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] monkey_patch = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] monkey_patch_modules = [] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] my_ip = 192.168.122.235 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] no_snapshot_gb_quota = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] num_iser_scan_tries = 3 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] num_shell_tries = 3 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] num_volume_device_scan_tries = 3 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] nvmeof_conn_info_version = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] nvmet_ns_id = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] nvmet_port_id = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] osapi_max_limit = 1000 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] osapi_volume_ext_list = [] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] osapi_volume_listen_port = 8776 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] osapi_volume_use_ssl = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] osapi_volume_workers = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] per_volume_size_limit = -1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] periodic_fuzzy_delay = 60 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] periodic_interval = 60 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] public_endpoint = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] publish_errors = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] quota_backup_gigabytes = 1000 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] quota_backups = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] quota_gigabytes = 1000 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] quota_groups = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] quota_snapshots = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] quota_volumes = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] rate_limit_burst = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] rate_limit_except_level = CRITICAL {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] rate_limit_interval = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] reinit_driver_count = 3 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] replication_device = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] report_discard_supported = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] report_interval = 120 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] reservation_clean_interval = 86400 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] reservation_expire = 86400 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] reserved_image_namespaces = [] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] reserved_percentage = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] rpc_response_timeout = 120 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] run_external_periodic_tasks = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] scst_target_driver = iscsi {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] scst_target_iqn_name = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] service_down_time = 720 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] shell_completion = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] snapshot_name_template = snapshot-%s {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] snapshot_same_host = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] split_loggers = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] state_path = /opt/stack/data/cinder {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] storage_availability_zone = nova {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] storage_protocol = iSCSI {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] syslog_log_facility = LOG_USER {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] target_helper = lioadm {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] target_ip_address = 192.168.122.235 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] target_port = 3260 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] target_protocol = iscsi {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] target_secondary_ip_addresses = [] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] trace_flags = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] transport_url = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] until_refresh = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] use_chap_auth = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] use_default_quota_class = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] use_journal = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] use_json = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] use_multipath_for_image_xfer = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] use_stderr = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] use_syslog = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] verify_glance_signatures = enabled {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volume_api_class = cinder.volume.api.API {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volume_backend_name = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volume_clear = zero {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volume_clear_ionice = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volume_clear_size = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volume_copy_bps_limit = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volume_dd_blocksize = 1M {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volume_name_template = volume-%s {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volume_service_inithost_offload = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volume_usage_audit_period = month {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] zoning_mode = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_concurrency.disable_process_locking = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.auth_section = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.auth_type = password {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.auth_version = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.cache = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.certfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.include_service_catalog = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.insecure = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.interface = public {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.keyfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_password = {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[78033]: INFO cinder.volume.manager [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcache_username = {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.region_name = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.service_type = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.backend = dogpile.cache.null {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.backend_argument = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.backend_expiration_time = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.config_prefix = cache.oslo {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.debug_cache_backend = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.enable_retry_client = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.enable_socket_keepalive = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.enabled = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.expiration_time = 600 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.hashclient_retry_attempts = 2 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.memcache_dead_retry = 300 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.memcache_pool_maxsize = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.memcache_sasl_enabled = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.password = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.proxies = [] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.redis_db = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.redis_server = localhost:6379 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.retry_attempts = 2 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.retry_delay = 0.0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.socket_keepalive_count = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.socket_keepalive_idle = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.socket_keepalive_interval = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.socket_timeout = 1.0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.tls_allowed_ciphers = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.tls_cafile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.tls_certfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.tls_enabled = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.tls_keyfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cache.username = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] coordination.backend_url = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.asyncio_connection = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.asyncio_slave_connection = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.backend = sqlalchemy {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.connection = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.connection_debug = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.connection_parameters = {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.connection_recycle_time = 3600 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.connection_trace = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.db_inc_retry_interval = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.db_max_retries = 20 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.db_max_retry_interval = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.db_retry_interval = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.max_overflow = 50 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.max_pool_size = 5 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.max_retries = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.mysql_wsrep_sync_wait = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.pool_timeout = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.retry_interval = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.slave_connection = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.sqlite_synchronous = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.synchronous_reader = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] database.use_db_reconnect = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler.connection_string = messaging:// {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler.enabled = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler.es_doc_type = notification {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler.es_scroll_size = 10000 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler.es_scroll_time = 2m {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler.filter_error_trace = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler.hmac_keys = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler.sentinel_service_name = mymaster {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler.socket_timeout = 0.1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler.trace_requests = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler.trace_sqlalchemy = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler_jaeger.process_tags = {} {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler_jaeger.service_name_prefix = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] profiler_otlp.service_name_prefix = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_policy.enforce_new_defaults = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_policy.policy_default_rule = default {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_policy.policy_file = policy.yaml {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] privsep_osbrick.group = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] privsep_osbrick.helper_command = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] privsep_osbrick.user = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cinder_sys_admin.group = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cinder_sys_admin.helper_command = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] cinder_sys_admin.user = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] service_user.auth_section = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] service_user.auth_type = password {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] service_user.cafile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] service_user.certfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] service_user.collect_timing = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] service_user.insecure = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] service_user.keyfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] service_user.send_service_user_token = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] service_user.split_loggers = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] service_user.timeout = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance.auth_section = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance.auth_type = password {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance.certfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance.collect_timing = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance.insecure = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance.keyfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance.region_name = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance.split_loggers = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] glance.timeout = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.backend_availability_zone = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.chap_password = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.chap_username = {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.disk_geometry = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.driver_client_cert = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.driver_client_cert_key = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.driver_data_namespace = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.driver_use_ssl = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.extra_capabilities = {} {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.filter_function = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.goodness_function = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.iscsi_target_flags = {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.iscsi_write_cache = on {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.iser_helper = tgtadm {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.iser_port = 3260 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.lvm_share_target = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.lvm_type = auto {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.num_shell_tries = 3 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.replication_device = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.report_discard_supported = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.reserved_percentage = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.target_helper = tgtadm {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.target_port = 3260 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.target_protocol = iscsi {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.trace_flags = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.unique_fqdn_network = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.use_chap_auth = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.volume_backend_name = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.volume_clear = zero {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.volume_clear_ionice = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.volume_clear_size = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_reports.file_event_handler = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_reports.log_dir = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.backend_host = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.chap_password = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.chap_username = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.disk_geometry = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.driver_client_cert = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.extra_capabilities = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.filter_function = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.goodness_function = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.iser_helper = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.iser_ip_address = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.iser_port = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.lvm_share_target = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.lvm_type = auto {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.num_shell_tries = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.replication_device = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.report_discard_supported = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.reserved_percentage = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.scst_target_driver = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.storage_protocol = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.target_helper = lioadm {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.target_ip_address = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.target_port = 3260 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.trace_flags = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.use_chap_auth = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.volume_clear = zero {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.volume_clear_size = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] lvmdriver-1.volumes_dir = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.ssl = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_notifications.driver = [] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_notifications.retry = -1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] key_manager.fixed_key = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.barbican_api_version = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.barbican_endpoint = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.barbican_endpoint_type = public {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.barbican_region_name = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.cafile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.certfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.collect_timing = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.insecure = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.keyfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.number_of_retries = 60 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.retry_delay = 1 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.send_service_user_token = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.split_loggers = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.timeout = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.verify_ssl = True {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican.verify_ssl_path = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican_service_user.auth_section = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican_service_user.auth_type = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican_service_user.cafile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican_service_user.certfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican_service_user.collect_timing = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican_service_user.insecure = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican_service_user.keyfile = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican_service_user.split_loggers = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] barbican_service_user.timeout = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.approle_role_id = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.approle_secret_id = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.auth_method = approle {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.auth_path = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.kv_mountpoint = secret {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.kv_path = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.kv_version = 2 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.namespace = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack sudo[78037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.root_token_id = **** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.ssl_ca_crt_file = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.timeout = 60.0 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.token_file = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.token_role = None {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.use_ssl = False {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:08 devstack sudo[78037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:08 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] ******************************************************************************** {{(pid=77879) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 10:44:08 devstack sudo[78037]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:08 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:08 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:08 devstack sudo[78041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:08 devstack sudo[78041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:09 devstack sudo[78041]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:09 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.317s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:09 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:44:09 devstack cinder-volume[78033]: INFO cinder.brick.local_dev.lvm [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 31 10:44:09 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:09 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:09 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:09 devstack sudo[78046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:44:09 devstack sudo[78046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:09 devstack sudo[78046]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:09 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:09 devstack cinder-volume[78033]: DEBUG cinder.brick.local_dev.lvm [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=78033) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 31 10:44:09 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:09 devstack sudo[78119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:09 devstack sudo[78119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:10 devstack sudo[78119]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:10 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.522s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:10 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:10 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:10 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:10 devstack sudo[78358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:10 devstack sudo[78358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:10 devstack sudo[78358]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:10 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:10 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:10 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:10 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:10 devstack sudo[78466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 31 10:44:10 devstack sudo[78466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:10 devstack sudo[78466]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:10 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.260s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:10 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:10 devstack sudo[78562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:44:10 devstack sudo[78562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:10 devstack sudo[78562]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:10 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:10 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:11 devstack sudo[78656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:44:11 devstack sudo[78656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:11 devstack sudo[78656]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:11 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:11 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:11 devstack sudo[78659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:11 devstack sudo[78659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:11 devstack sudo[78659]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:11 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:11 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:11 devstack sudo[78743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:11 devstack sudo[78743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:11 devstack sudo[78743]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:11 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:11 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:11 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:11 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:11 devstack sudo[78748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:11 devstack sudo[78748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:12 devstack sudo[78748]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:12 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:12 devstack cinder-volume[78033]: INFO cinder.volume.drivers.lvm [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 31 10:44:12 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:12 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:12 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:12 devstack sudo[78825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:12 devstack sudo[78825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:12 devstack sudo[78825]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:12 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:12 devstack cinder-volume[78033]: DEBUG cinder.volume.drivers.lvm [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Updating volume stats {{(pid=78033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:44:12 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:12 devstack sudo[78841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:44:12 devstack sudo[78841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:12 devstack sudo[78841]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:12 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:12 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:12 devstack sudo[78844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:12 devstack sudo[78844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:12 devstack sudo[78844]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:12 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:12 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:13 devstack sudo[78853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:13 devstack sudo[78853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:13 devstack sudo[78853]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:13 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:13 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:13 devstack sudo[78856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:13 devstack sudo[78856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:13 devstack sudo[78856]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:13 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:13 devstack cinder-volume[78033]: INFO cinder.volume.driver [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Driver hasn't implemented _init_vendor_properties() Jul 31 10:44:13 devstack cinder-volume[78033]: DEBUG cinder.volume.driver [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=78033) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 10:44:13 devstack cinder-volume[78033]: DEBUG oslo_db.sqlalchemy.engines [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78033) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:44:13 devstack cinder-volume[78033]: DEBUG dbcounter [-] [78033] Writer thread running {{(pid=78033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:44:13 devstack cinder-volume[78033]: DEBUG cinder.db.api [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Building query based on filter {{(pid=78033) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 10:44:13 devstack cinder-volume[78033]: DEBUG cinder.image.image_utils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=78033) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 10:44:13 devstack cinder-volume[78033]: INFO cinder.keymgr.migration [None req-b0040588-e332-411a-b82e-125fc684309b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 10:44:13 devstack cinder-volume[78033]: DEBUG cinder.volume.drivers.lvm [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Updating volume stats {{(pid=78033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:44:13 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:13 devstack sudo[78860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:44:13 devstack sudo[78860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:13 devstack sudo[78860]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:13 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:13 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:13 devstack sudo[78863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:13 devstack sudo[78863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:14 devstack sudo[78863]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:14 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:14 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:14 devstack sudo[78866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:14 devstack sudo[78866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:14 devstack sudo[78866]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:14 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:14 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:14 devstack sudo[78871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:14 devstack sudo[78871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:14 devstack sudo[78871]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:14 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:14 devstack cinder-volume[78033]: DEBUG cinder.manager [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Notifying Schedulers of capabilities ... {{(pid=78033) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:44:14 devstack cinder-volume[78033]: INFO cinder.volume.manager [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Driver initialization completed successfully. Jul 31 10:44:14 devstack cinder-volume[78033]: INFO cinder.manager [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Initiating service 2 cleanup Jul 31 10:44:14 devstack cinder-volume[78033]: INFO cinder.manager [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Service 2 cleanup completed. Jul 31 10:44:14 devstack cinder-volume[78033]: DEBUG cinder.service [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Creating RPC server for service cinder-volume {{(pid=78033) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 10:44:14 devstack cinder-volume[78033]: DEBUG cinder.service [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=78033) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 10:44:14 devstack cinder-volume[78033]: INFO cinder.volume.manager [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 31 10:44:14 devstack cinder-volume[78033]: DEBUG cinder.volume.drivers.lvm [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Updating volume stats {{(pid=78033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:44:14 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:14 devstack sudo[78875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:44:14 devstack sudo[78875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:15 devstack sudo[78875]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:15 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:15 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:15 devstack sudo[78878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:15 devstack sudo[78878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:15 devstack sudo[78878]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:15 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:15 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:15 devstack sudo[78883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:15 devstack sudo[78883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:15 devstack sudo[78883]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:15 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:15 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:15 devstack sudo[78886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:15 devstack sudo[78886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:15 devstack sudo[78886]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:15 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:16 devstack cinder-volume[78033]: INFO cinder.volume.manager [None req-a7e8d3da-3ed8-4dcc-9825-2f5034304d45 None None] Driver post RPC initialization completed successfully. Jul 31 10:44:18 devstack cinder-volume[77879]: DEBUG dbcounter [-] [77879] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:44:24 devstack cinder-volume[78033]: DEBUG dbcounter [-] [78033] Writing DB stats cinder:SELECT=4 {{(pid=78033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:44:26 devstack cinder-volume[78033]: DEBUG dbcounter [-] [78033] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=78033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:44:27 devstack cinder-volume[78033]: DEBUG oslo_service.periodic_task [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running periodic task VolumeManager._thread_info {{(pid=78033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:44:27 devstack cinder-volume[78033]: DEBUG cinder.volume.manager [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] thread count: 6 {{(pid=78033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:44:27 devstack cinder-volume[78033]: DEBUG cinder.volume.manager [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] thread info: [<_MainThread(MainThread, started 129928600305792)>, , , , , ] {{(pid=78033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:45:27 devstack cinder-volume[78033]: DEBUG oslo_service.periodic_task [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:45:27 devstack cinder-volume[78033]: DEBUG cinder.volume.drivers.lvm [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Updating volume stats {{(pid=78033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:45:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:27 devstack sudo[81163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:45:27 devstack sudo[81163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:27 devstack sudo[81163]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:27 devstack sudo[81166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:45:27 devstack sudo[81166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:27 devstack sudo[81166]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:27 devstack sudo[81169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:45:27 devstack sudo[81169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:27 devstack sudo[81169]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:27 devstack sudo[81282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:45:27 devstack sudo[81282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:28 devstack sudo[81282]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:28 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:28 devstack cinder-volume[78033]: DEBUG cinder.manager [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Notifying Schedulers of capabilities ... {{(pid=78033) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:45:28 devstack cinder-volume[78033]: DEBUG oslo_service.periodic_task [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running periodic task VolumeManager._thread_info {{(pid=78033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:45:28 devstack cinder-volume[78033]: DEBUG cinder.volume.manager [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] thread count: 6 {{(pid=78033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:45:28 devstack cinder-volume[78033]: DEBUG cinder.volume.manager [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] thread info: [<_MainThread(MainThread, started 129928600305792)>, , , , , ] {{(pid=78033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:46:26 devstack cinder-volume[78033]: DEBUG dbcounter [-] [78033] Writing DB stats cinder:SELECT=1 {{(pid=78033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:46:26 devstack cinder-volume[78033]: DEBUG dbcounter [-] [78033] Writing DB stats cinder:UPDATE=1 {{(pid=78033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:46:27 devstack cinder-volume[78033]: DEBUG oslo_service.periodic_task [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:46:27 devstack cinder-volume[78033]: DEBUG cinder.volume.drivers.lvm [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Updating volume stats {{(pid=78033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:46:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:27 devstack sudo[84364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:46:27 devstack sudo[84364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:27 devstack sudo[84364]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:27 devstack sudo[84372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:46:27 devstack sudo[84372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:27 devstack sudo[84372]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:27 devstack sudo[84375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:46:27 devstack sudo[84375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:27 devstack sudo[84375]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:27 devstack sudo[84384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:46:27 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:28 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:28 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:28 devstack cinder-volume[78033]: DEBUG cinder.manager [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Notifying Schedulers of capabilities ... {{(pid=78033) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:46:28 devstack cinder-volume[78033]: DEBUG oslo_service.periodic_task [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running periodic task VolumeManager._thread_info {{(pid=78033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:46:28 devstack cinder-volume[78033]: DEBUG cinder.volume.manager [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] thread count: 6 {{(pid=78033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:46:28 devstack cinder-volume[78033]: DEBUG cinder.volume.manager [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] thread info: [<_MainThread(MainThread, started 129928600305792)>, , , , , ] {{(pid=78033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:47:27 devstack cinder-volume[78033]: DEBUG oslo_service.periodic_task [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:47:27 devstack cinder-volume[78033]: DEBUG cinder.volume.drivers.lvm [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Updating volume stats {{(pid=78033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:47:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:27 devstack sudo[86383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:47:27 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:27 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:27 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:47:27 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:27 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:27 devstack sudo[86400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:47:27 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:27 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:27 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:47:27 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:28 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:28 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:28 devstack cinder-volume[78033]: DEBUG cinder.manager [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Notifying Schedulers of capabilities ... {{(pid=78033) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:48:26 devstack cinder-volume[78033]: DEBUG dbcounter [-] [78033] Writing DB stats cinder:SELECT=1 {{(pid=78033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:48:26 devstack cinder-volume[78033]: DEBUG dbcounter [-] [78033] Writing DB stats cinder:UPDATE=1 {{(pid=78033) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:48:27 devstack cinder-volume[78033]: DEBUG oslo_service.periodic_task [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:48:27 devstack cinder-volume[78033]: DEBUG cinder.volume.drivers.lvm [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Updating volume stats {{(pid=78033) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:48:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:27 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:48:27 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:27 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:27 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:48:27 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:27 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:27 devstack sudo[87665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:48:27 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:27 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:27 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:27 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:48:27 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:28 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:28 devstack cinder-volume[78033]: DEBUG oslo_concurrency.processutils [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=78033) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:28 devstack cinder-volume[78033]: DEBUG cinder.manager [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Notifying Schedulers of capabilities ... {{(pid=78033) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:48:28 devstack cinder-volume[78033]: DEBUG oslo_service.periodic_task [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] Running periodic task VolumeManager._thread_info {{(pid=78033) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:48:28 devstack cinder-volume[78033]: DEBUG cinder.volume.manager [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] thread count: 6 {{(pid=78033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:48:28 devstack cinder-volume[78033]: DEBUG cinder.volume.manager [None req-3e3d5a1b-9c78-4a06-8293-bd442727ce4f None None] thread info: [<_MainThread(MainThread, started 129928600305792)>, , , , , ] {{(pid=78033) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:48:47 devstack cinder-volume[77879]: INFO oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Caught SIGTERM, stopping children Jul 31 10:48:47 devstack cinder-volume[77879]: DEBUG oslo_concurrency.lockutils [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Acquiring lock "singleton_lock" {{(pid=77879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:48:47 devstack cinder-volume[77879]: DEBUG oslo_concurrency.lockutils [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Acquired lock "singleton_lock" {{(pid=77879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:48:47 devstack cinder-volume[77879]: DEBUG oslo_concurrency.lockutils [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Releasing lock "singleton_lock" {{(pid=77879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:48:47 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Stop services. {{(pid=77879) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 31 10:48:47 devstack cinder-volume[77879]: DEBUG oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Killing children. {{(pid=77879) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 31 10:48:47 devstack cinder-volume[77879]: INFO oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Waiting on 1 children to exit Jul 31 10:48:49 devstack cinder-volume[78033]: DEBUG oslo_concurrency.lockutils [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Acquiring lock "singleton_lock" {{(pid=78033) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:48:49 devstack cinder-volume[78033]: DEBUG oslo_concurrency.lockutils [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Acquired lock "singleton_lock" {{(pid=78033) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:48:49 devstack cinder-volume[78033]: DEBUG oslo_concurrency.lockutils [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Releasing lock "singleton_lock" {{(pid=78033) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:48:49 devstack cinder-volume[78033]: WARNING amqp [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 10:48:49 devstack cinder-volume[78033]: WARNING amqp [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 10:48:49 devstack cinder-volume[77879]: INFO oslo_service.backend._eventlet.service [None req-8adaf719-a023-482d-bd90-4c5836f7cbe1 None None] Child 78033 exited with status 0 Jul 31 10:48:50 devstack cinder-volume[88175]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 10:48:50 devstack cinder-volume[88175]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 10:48:50 devstack cinder-volume[88175]: we strongly recommend against using it for new projects. Jul 31 10:48:50 devstack cinder-volume[88175]: If you are already using Eventlet, we recommend migrating to a different Jul 31 10:48:50 devstack cinder-volume[88175]: framework. For more detail see Jul 31 10:48:50 devstack cinder-volume[88175]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 10:48:50 devstack cinder-volume[88175]: import eventlet # noqa Jul 31 10:48:52 devstack cinder-volume[88175]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:48:52 devstack cinder-volume[88175]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:48:52 devstack cinder-volume[88175]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:48:53 devstack cinder-volume[88175]: INFO dbcounter [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Registered counter for database cinder Jul 31 10:48:53 devstack cinder-volume[88175]: DEBUG oslo_db.sqlalchemy.engines [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88175) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:48:53 devstack cinder-volume[88175]: DEBUG dbcounter [-] [88175] Writer thread running {{(pid=88175) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:48:53 devstack cinder-volume[88175]: INFO cinder.rpc [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 10:48:53 devstack cinder-volume[88175]: INFO cinder.rpc [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_db.sqlalchemy.engines [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88175) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:48:54 devstack cinder-volume[88175]: INFO cinder.volume.manager [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Determined volume DB was empty at startup. Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG cinder.volume.manager [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88175) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 10:48:54 devstack cinder-volume[88175]: INFO cinder.volume.manager [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 31 10:48:54 devstack cinder-volume[88175]: WARNING stevedore.named [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 10:48:54 devstack cinder-volume[88175]: WARNING castellan.key_manager [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:48:54 devstack cinder-volume[88175]: WARNING cinder.keymgr.conf_key_mgr [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:48:54 devstack cinder-volume[88175]: INFO cinder.volume.manager [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_db.sqlalchemy.engines [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88175) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:48:54 devstack cinder-volume[88175]: INFO oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Starting 1 workers Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Started child 88402 {{(pid=88175) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Full set of CONF: {{(pid=88175) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] ******************************************************************************** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Configuration options gathered from: {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] ================================================================================ {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] allow_availability_zone_fallback = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] allow_compression_on_image_upload = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] allowed_direct_url_schemes = [] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] api_rate_limit = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] auth_strategy = keystone {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_availability_zone = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_host = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_name = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_stats_polling_interval = 60 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backup_api_class = cinder.backup.api.API {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88402]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backup_name_template = backup-%s {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backup_use_same_host = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backup_use_temp_snapshot = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] chap_password = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] chap_username = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cinder_internal_tenant_project_id = bb2527ce35b74208bfdd600f5055253d {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cinder_internal_tenant_user_id = 50bc310f4d5342ca9bf82e8c0d65e776 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cluster = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] compression_format = gzip {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] compute_api_class = cinder.compute.nova.API {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] config_dir = [] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] config_source = [] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] control_exchange = openstack {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] debug = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] default_availability_zone = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] default_group_type = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] default_volume_type = QuobyteHD {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] disk_geometry = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] driver_client_cert = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] driver_client_cert_key = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] driver_data_namespace = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] driver_ssl_cert_path = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] driver_ssl_cert_verify = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] driver_use_ssl = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] enable_new_services = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] enable_unsupported_driver = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] enabled_backends = ['QuobyteHD'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] enforce_multipath_for_image_xfer = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] filter_function = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance_api_insecure = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance_api_ssl_compression = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance_ca_certificates_file = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance_catalog_info = image:glance:publicURL {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance_certfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance_keyfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance_num_retries = 3 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance_request_timeout = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] goodness_function = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] graceful_shutdown_timeout = 5 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] group_api_class = cinder.group.api.API {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] host = devstack {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] image_compress_on_upload = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] image_conversion_address_space_limit = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] image_conversion_cpu_limit = 60 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] image_conversion_disable = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] image_upload_use_cinder_backend = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] image_upload_use_internal_tenant = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] image_volume_cache_enabled = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] image_volume_cache_max_count = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] image_volume_cache_max_size_gb = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] init_host_max_objects_retrieval = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] instance_format = [instance: %(uuid)s] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] iscsi_target_flags = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] iscsi_write_cache = on {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] iser_helper = tgtadm {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] iser_ip_address = 192.168.122.235 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] iser_port = 3260 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] log_color = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] log_config_append = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] log_dir = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] log_file = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] log_options = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] log_rotate_interval = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] log_rotate_interval_type = days {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] log_rotation_type = none {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] max_age = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] max_logfile_count = 30 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] max_logfile_size_mb = 200 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] max_over_subscription_ratio = 20.0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] message_reap_interval = 86400 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] message_ttl = 2592000 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] migration_create_volume_timeout_secs = 300 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] monkey_patch = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] monkey_patch_modules = [] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] my_ip = 192.168.122.235 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] no_snapshot_gb_quota = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] num_iser_scan_tries = 3 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] num_shell_tries = 3 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] num_volume_device_scan_tries = 3 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] nvmeof_conn_info_version = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] nvmet_ns_id = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] nvmet_port_id = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] osapi_max_limit = 1000 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] osapi_volume_ext_list = [] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] osapi_volume_listen_port = 8776 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] osapi_volume_use_ssl = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] osapi_volume_workers = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88402]: INFO cinder.volume.manager [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Starting volume driver QuobyteDriver (1.1.14) Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] per_volume_size_limit = -1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88402]: DEBUG cinder.volume.drivers.remotefs [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88402) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] periodic_fuzzy_delay = 60 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] periodic_interval = 60 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] public_endpoint = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] publish_errors = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] quota_backup_gigabytes = 1000 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] quota_backups = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] quota_gigabytes = 1000 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] quota_groups = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] quota_snapshots = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] quota_volumes = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] rate_limit_burst = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] rate_limit_except_level = CRITICAL {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] rate_limit_interval = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] reinit_driver_count = 3 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] replication_device = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] report_discard_supported = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] report_interval = 120 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] reservation_clean_interval = 86400 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] reservation_expire = 86400 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] reserved_image_namespaces = [] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] reserved_percentage = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] rpc_response_timeout = 120 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] run_external_periodic_tasks = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] scst_target_driver = iscsi {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] scst_target_iqn_name = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] service_down_time = 720 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] shell_completion = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] snapshot_name_template = snapshot-%s {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] split_loggers = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] state_path = /opt/stack/data/cinder {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] storage_availability_zone = nova {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] storage_protocol = iSCSI {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] syslog_log_facility = LOG_USER {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] target_helper = lioadm {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] target_ip_address = 192.168.122.235 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] target_port = 3260 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] target_protocol = iscsi {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] target_secondary_ip_addresses = [] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] trace_flags = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] transport_url = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] until_refresh = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] use_chap_auth = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] use_default_quota_class = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] use_journal = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] use_json = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] use_multipath_for_image_xfer = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] use_stderr = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] use_syslog = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] verify_glance_signatures = enabled {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volume_api_class = cinder.volume.api.API {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volume_backend_name = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volume_clear = zero {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volume_clear_ionice = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volume_clear_size = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volume_copy_bps_limit = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volume_dd_blocksize = 1M {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volume_name_template = volume-%s {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volume_service_inithost_offload = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volume_usage_audit_period = month {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] zoning_mode = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_concurrency.disable_process_locking = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.auth_section = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.auth_type = password {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.auth_version = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.cache = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.certfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.include_service_catalog = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.insecure = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.interface = public {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.keyfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_password = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcache_username = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.region_name = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.service_type = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.backend = dogpile.cache.null {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.backend_argument = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.backend_expiration_time = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.config_prefix = cache.oslo {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.debug_cache_backend = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.enable_retry_client = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.enable_socket_keepalive = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.enabled = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.expiration_time = 600 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.hashclient_retry_attempts = 2 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.memcache_dead_retry = 300 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.memcache_pool_maxsize = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.memcache_sasl_enabled = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.password = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.proxies = [] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.redis_db = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.redis_server = localhost:6379 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.retry_attempts = 2 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.retry_delay = 0.0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.socket_keepalive_count = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.socket_keepalive_idle = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.socket_keepalive_interval = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.socket_timeout = 1.0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.tls_allowed_ciphers = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.tls_cafile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.tls_certfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.tls_enabled = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.tls_keyfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cache.username = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] coordination.backend_url = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.asyncio_connection = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.asyncio_slave_connection = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.backend = sqlalchemy {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.connection = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.connection_debug = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.connection_parameters = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.connection_recycle_time = 3600 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.connection_trace = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.db_inc_retry_interval = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.db_max_retries = 20 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.db_max_retry_interval = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.db_retry_interval = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.max_overflow = 50 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.max_pool_size = 5 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.max_retries = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.mysql_wsrep_sync_wait = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.pool_timeout = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.retry_interval = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.slave_connection = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.sqlite_synchronous = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.synchronous_reader = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] database.use_db_reconnect = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler.connection_string = messaging:// {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler.enabled = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler.es_doc_type = notification {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler.es_scroll_size = 10000 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler.es_scroll_time = 2m {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler.filter_error_trace = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler.hmac_keys = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler.sentinel_service_name = mymaster {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler.socket_timeout = 0.1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler.trace_requests = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler.trace_sqlalchemy = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler_jaeger.process_tags = {} {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler_jaeger.service_name_prefix = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] profiler_otlp.service_name_prefix = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_policy.enforce_new_defaults = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_policy.policy_default_rule = default {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88402]: DEBUG cinder.volume.drivers.quobyte [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88402) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 31 10:48:54 devstack cinder-volume[88402]: WARNING cinder.volume.drivers.quobyte [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 31 10:48:54 devstack cinder-volume[88402]: WARNING cinder.volume.drivers.quobyte [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_policy.policy_file = policy.yaml {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88402]: DEBUG oslo_concurrency.processutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Running cmd (subprocess): mount.quobyte {{(pid=88402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] privsep_osbrick.group = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] privsep_osbrick.helper_command = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] privsep_osbrick.user = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cinder_sys_admin.group = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cinder_sys_admin.helper_command = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] cinder_sys_admin.user = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] service_user.auth_section = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] service_user.auth_type = password {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] service_user.cafile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] service_user.certfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] service_user.collect_timing = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] service_user.insecure = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] service_user.keyfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] service_user.send_service_user_token = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] service_user.split_loggers = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] service_user.timeout = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance.auth_section = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance.auth_type = password {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance.certfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance.collect_timing = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance.insecure = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance.keyfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance.region_name = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance.split_loggers = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] glance.timeout = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.backend_availability_zone = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.chap_password = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.chap_username = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.disk_geometry = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.driver_client_cert = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.driver_client_cert_key = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.driver_data_namespace = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.driver_use_ssl = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.extra_capabilities = {} {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.filter_function = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.goodness_function = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.iscsi_target_flags = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.iscsi_write_cache = on {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.iser_helper = tgtadm {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.iser_port = 3260 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nas_host = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nas_login = admin {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nas_mount_options = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nas_password = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nas_private_key = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nas_share_path = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.num_shell_tries = 3 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.quobyte_volume_url = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.replication_device = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.report_discard_supported = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.reserved_percentage = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.target_helper = tgtadm {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.target_port = 3260 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.target_protocol = iscsi {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.trace_flags = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.unique_fqdn_network = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.use_chap_auth = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.volume_backend_name = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.volume_clear = zero {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.volume_clear_ionice = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.volume_clear_size = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_reports.file_event_handler = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_reports.log_dir = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.backend_availability_zone = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.backend_host = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.chap_password = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.chap_username = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.chiscsi_conf = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.disk_geometry = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.driver_client_cert = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.driver_data_namespace = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.driver_use_ssl = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.extra_capabilities = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.filter_function = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.goodness_function = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack quobyte-client[88403]: Reading configuration file: /etc/quobyte/client.cfg Jul 31 10:48:54 devstack quobyte-client[88403]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88402]: DEBUG oslo_concurrency.processutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] CMD "mount.quobyte" returned: 1 in 0.106s {{(pid=88402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.iser_helper = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.iser_ip_address = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.iser_port = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.iser_target_prefix = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88402]: DEBUG oslo_concurrency.lockutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nas_host = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88402]: DEBUG oslo_concurrency.lockutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nas_login = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88402]: DEBUG cinder.volume.drivers.quobyte [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=88402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nas_mount_options = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nas_password = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nas_private_key = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nas_share_path = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nas_ssh_port = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.num_shell_tries = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.nvmet_port_id = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88402]: INFO cinder.volume.drivers.quobyte [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 ... Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88402]: DEBUG oslo_concurrency.processutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 -c /etc/quobyte/client-cinder.cfg {{(pid=88402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.replication_device = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.report_discard_supported = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.reserved_percentage = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.scst_target_driver = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.storage_protocol = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.target_helper = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.target_ip_address = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.target_port = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.target_prefix = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.target_protocol = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.trace_flags = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.use_chap_auth = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.volume_clear = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.volume_clear_size = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] QuobyteHD.volumes_dir = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.ssl = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_notifications.driver = [] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_notifications.retry = -1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] key_manager.fixed_key = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.barbican_api_version = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.barbican_endpoint = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.barbican_endpoint_type = public {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.barbican_region_name = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.cafile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.certfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.collect_timing = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.insecure = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.keyfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.number_of_retries = 60 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.retry_delay = 1 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.send_service_user_token = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.split_loggers = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.timeout = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.verify_ssl = True {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican.verify_ssl_path = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican_service_user.auth_section = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican_service_user.auth_type = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican_service_user.cafile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican_service_user.certfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican_service_user.collect_timing = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican_service_user.insecure = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican_service_user.keyfile = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican_service_user.split_loggers = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] barbican_service_user.timeout = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.approle_role_id = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.approle_secret_id = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.auth_method = approle {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.auth_path = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.kv_mountpoint = secret {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.kv_path = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.kv_version = 2 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.namespace = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.root_token_id = **** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.ssl_ca_crt_file = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.timeout = 60.0 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.token_file = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.token_role = None {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.use_ssl = False {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:54 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] ******************************************************************************** {{(pid=88175) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 10:48:54 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 -c /etc/quobyte/client-cinder.cfg Jul 31 10:48:54 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:55 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.processutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.587s {{(pid=88402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:55 devstack cinder-volume[88402]: INFO cinder.volume.drivers.quobyte [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 succeeded Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG cinder.volume.drivers.quobyte [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=88402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.lockutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.607s {{(pid=88402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.processutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=88402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:55 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:48:55 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:55 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.processutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.285s {{(pid=88402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:55 devstack cinder-volume[88402]: INFO cinder.volume.driver [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Driver hasn't implemented _init_vendor_properties() Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG cinder.volume.driver [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5441589355469, 'free_capacity_gb': 1775.5441589355469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88402) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_db.sqlalchemy.engines [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88402) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG dbcounter [-] [88402] Writer thread running {{(pid=88402) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG cinder.db.api [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Building query based on filter {{(pid=88402) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG cinder.image.image_utils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88402) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 10:48:55 devstack cinder-volume[88402]: INFO cinder.keymgr.migration [None req-48c160bf-96fc-4737-a89b-073edeaad4cc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.lockutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.lockutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG cinder.volume.drivers.quobyte [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=88402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG cinder.volume.drivers.quobyte [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=88402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.lockutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.processutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=88402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:55 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:48:55 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:55 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.processutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.264s {{(pid=88402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG cinder.manager [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Notifying Schedulers of capabilities ... {{(pid=88402) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:48:55 devstack cinder-volume[88402]: INFO cinder.volume.manager [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Driver initialization completed successfully. Jul 31 10:48:55 devstack cinder-volume[88402]: INFO cinder.manager [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Initiating service 3 cleanup Jul 31 10:48:55 devstack cinder-volume[88402]: INFO cinder.manager [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Service 3 cleanup completed. Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG cinder.service [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Creating RPC server for service cinder-volume {{(pid=88402) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG cinder.service [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88402) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 10:48:55 devstack cinder-volume[88402]: INFO cinder.volume.manager [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.lockutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.lockutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG cinder.volume.drivers.quobyte [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=88402) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG cinder.volume.drivers.quobyte [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=88402) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.lockutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88402) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:55 devstack cinder-volume[88402]: DEBUG oslo_concurrency.processutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=88402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:56 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:48:56 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:56 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:56 devstack cinder-volume[88402]: DEBUG oslo_concurrency.processutils [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.268s {{(pid=88402) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:56 devstack cinder-volume[88402]: INFO cinder.volume.manager [None req-8523fb00-e44b-433b-a45b-a7e2de055dde None None] Driver post RPC initialization completed successfully. Jul 31 10:49:01 devstack cinder-volume[88175]: INFO oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Caught SIGTERM, stopping children Jul 31 10:49:01 devstack cinder-volume[88175]: DEBUG oslo_concurrency.lockutils [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Acquiring lock "singleton_lock" {{(pid=88175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:49:01 devstack cinder-volume[88175]: DEBUG oslo_concurrency.lockutils [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Acquired lock "singleton_lock" {{(pid=88175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:49:01 devstack cinder-volume[88175]: DEBUG oslo_concurrency.lockutils [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Releasing lock "singleton_lock" {{(pid=88175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:49:01 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Stop services. {{(pid=88175) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 31 10:49:01 devstack cinder-volume[88175]: DEBUG oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Killing children. {{(pid=88175) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 31 10:49:01 devstack cinder-volume[88175]: INFO oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Waiting on 1 children to exit Jul 31 10:49:04 devstack cinder-volume[88402]: DEBUG oslo_concurrency.lockutils [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Acquiring lock "singleton_lock" {{(pid=88402) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:49:04 devstack cinder-volume[88402]: DEBUG oslo_concurrency.lockutils [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Acquired lock "singleton_lock" {{(pid=88402) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:49:04 devstack cinder-volume[88402]: DEBUG oslo_concurrency.lockutils [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Releasing lock "singleton_lock" {{(pid=88402) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:49:04 devstack cinder-volume[88402]: WARNING amqp [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 10:49:04 devstack cinder-volume[88402]: WARNING amqp [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 10:49:04 devstack cinder-volume[88175]: INFO oslo_service.backend._eventlet.service [None req-07fd1582-d7e2-4db9-966f-f22e8f5e74c0 None None] Child 88402 exited with status 0 Jul 31 10:49:05 devstack cinder-volume[88831]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 10:49:05 devstack cinder-volume[88831]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 10:49:05 devstack cinder-volume[88831]: we strongly recommend against using it for new projects. Jul 31 10:49:05 devstack cinder-volume[88831]: If you are already using Eventlet, we recommend migrating to a different Jul 31 10:49:05 devstack cinder-volume[88831]: framework. For more detail see Jul 31 10:49:05 devstack cinder-volume[88831]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 10:49:05 devstack cinder-volume[88831]: import eventlet # noqa Jul 31 10:49:08 devstack cinder-volume[88831]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88831) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:49:08 devstack cinder-volume[88831]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88831) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:49:08 devstack cinder-volume[88831]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88831) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:49:09 devstack cinder-volume[88831]: INFO dbcounter [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] Registered counter for database cinder Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_db.sqlalchemy.engines [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88831) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG dbcounter [-] [88831] Writer thread running {{(pid=88831) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:49:09 devstack cinder-volume[88831]: INFO cinder.rpc [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 10:49:09 devstack cinder-volume[88831]: INFO cinder.rpc [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_db.sqlalchemy.engines [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88831) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:49:09 devstack cinder-volume[88831]: INFO cinder.volume.manager [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] Determined volume DB was empty at startup. Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG cinder.volume.manager [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88831) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 10:49:09 devstack cinder-volume[88831]: WARNING stevedore.named [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 10:49:09 devstack cinder-volume[88831]: WARNING castellan.key_manager [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:49:09 devstack cinder-volume[88831]: WARNING cinder.keymgr.conf_key_mgr [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:49:09 devstack cinder-volume[88831]: INFO cinder.volume.manager [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_db.sqlalchemy.engines [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88831) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:49:09 devstack cinder-volume[88831]: INFO oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] Starting 1 workers Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] Started child 89145 {{(pid=88831) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] Full set of CONF: {{(pid=88831) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] ******************************************************************************** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] Configuration options gathered from: {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] ================================================================================ {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 10:49:09 devstack cinder-volume[89145]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] allow_availability_zone_fallback = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] allow_compression_on_image_upload = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] allowed_direct_url_schemes = [] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] api_rate_limit = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] auth_strategy = keystone {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_availability_zone = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_host = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_name = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_stats_polling_interval = 60 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backup_api_class = cinder.backup.api.API {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backup_name_template = backup-%s {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backup_use_same_host = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backup_use_temp_snapshot = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] chap_password = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] chap_username = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cinder_internal_tenant_project_id = bb2527ce35b74208bfdd600f5055253d {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cinder_internal_tenant_user_id = 50bc310f4d5342ca9bf82e8c0d65e776 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cluster = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] compression_format = gzip {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] compute_api_class = cinder.compute.nova.API {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] config_dir = [] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] config_source = [] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] control_exchange = openstack {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] debug = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] default_availability_zone = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] default_group_type = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] default_volume_type = QuobyteHD {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] disk_geometry = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] driver_client_cert = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] driver_client_cert_key = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] driver_data_namespace = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] driver_ssl_cert_path = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] driver_ssl_cert_verify = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] driver_use_ssl = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] enable_new_services = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] enable_unsupported_driver = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] enabled_backends = ['QuobyteHD'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] enforce_multipath_for_image_xfer = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] filter_function = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance_api_insecure = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance_api_ssl_compression = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance_ca_certificates_file = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance_catalog_info = image:glance:publicURL {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance_certfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance_keyfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance_num_retries = 3 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance_request_timeout = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] goodness_function = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] graceful_shutdown_timeout = 5 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] group_api_class = cinder.group.api.API {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] host = devstack {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] image_compress_on_upload = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] image_conversion_address_space_limit = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] image_conversion_cpu_limit = 60 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] image_conversion_disable = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] image_upload_use_cinder_backend = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] image_upload_use_internal_tenant = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] image_volume_cache_enabled = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] image_volume_cache_max_count = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] image_volume_cache_max_size_gb = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] init_host_max_objects_retrieval = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] instance_format = [instance: %(uuid)s] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] iscsi_target_flags = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] iscsi_write_cache = on {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] iser_helper = tgtadm {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] iser_ip_address = 192.168.122.235 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] iser_port = 3260 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] log_color = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] log_config_append = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] log_dir = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] log_file = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] log_options = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] log_rotate_interval = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] log_rotate_interval_type = days {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] log_rotation_type = none {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] max_age = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] max_logfile_count = 30 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] max_logfile_size_mb = 200 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] max_over_subscription_ratio = 20.0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] message_reap_interval = 86400 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] message_ttl = 2592000 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] migration_create_volume_timeout_secs = 300 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] monkey_patch = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] monkey_patch_modules = [] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] my_ip = 192.168.122.235 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] no_snapshot_gb_quota = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] num_iser_scan_tries = 3 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] num_shell_tries = 3 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] num_volume_device_scan_tries = 3 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] nvmeof_conn_info_version = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] nvmet_ns_id = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] nvmet_port_id = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] osapi_max_limit = 1000 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] osapi_volume_ext_list = [] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] osapi_volume_listen = 0.0.0.0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] osapi_volume_listen_port = 8776 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] osapi_volume_use_ssl = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] osapi_volume_workers = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] per_volume_size_limit = -1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] periodic_fuzzy_delay = 60 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] periodic_interval = 60 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] project_id_regex = [0-9a-f\-]+ {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] public_endpoint = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] publish_errors = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] quota_backup_gigabytes = 1000 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] quota_backups = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] quota_gigabytes = 1000 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] quota_groups = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] quota_snapshots = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] quota_volumes = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] rate_limit_burst = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] rate_limit_except_level = CRITICAL {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] rate_limit_interval = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] reinit_driver_count = 3 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] replication_device = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] report_discard_supported = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] report_interval = 120 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] reservation_clean_interval = 86400 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] reservation_expire = 86400 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] reserved_image_namespaces = [] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] reserved_percentage = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] rpc_response_timeout = 120 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] run_external_periodic_tasks = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] scst_target_driver = iscsi {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] scst_target_iqn_name = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] service_down_time = 720 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] shell_completion = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] snapshot_name_template = snapshot-%s {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] split_loggers = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] state_path = /opt/stack/data/cinder {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] storage_availability_zone = nova {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] storage_protocol = iSCSI {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] syslog_log_facility = LOG_USER {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] target_helper = lioadm {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] target_ip_address = 192.168.122.235 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] target_port = 3260 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:09 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] target_protocol = iscsi {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] target_secondary_ip_addresses = [] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] trace_flags = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] transfer_api_class = cinder.transfer.api.API {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] transport_url = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] until_refresh = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] use_chap_auth = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] use_default_quota_class = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] use_journal = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] use_json = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] use_multipath_for_image_xfer = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] use_stderr = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] use_syslog = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] verify_glance_signatures = enabled {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volume_api_class = cinder.volume.api.API {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volume_backend_name = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=89145) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volume_clear = zero {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volume_clear_ionice = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volume_clear_size = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volume_copy_bps_limit = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volume_dd_blocksize = 1M {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volume_name_template = volume-%s {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volume_service_inithost_offload = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volume_usage_audit_period = month {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] zoning_mode = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_concurrency.disable_process_locking = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.auth_section = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.auth_type = password {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.auth_version = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.cache = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.certfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.delay_auth_decision = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.http_connect_timeout = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.include_service_catalog = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.insecure = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.interface = public {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.keyfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_password = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcache_username = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.region_name = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.service_token_roles_required = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.service_type = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.token_cache_time = 300 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.backend = dogpile.cache.null {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.backend_argument = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.backend_expiration_time = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.config_prefix = cache.oslo {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.debug_cache_backend = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.enable_retry_client = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.enable_socket_keepalive = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.enabled = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.expiration_time = 600 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.hashclient_retry_attempts = 2 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.memcache_dead_retry = 300 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.memcache_pool_maxsize = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.memcache_sasl_enabled = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.password = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.proxies = [] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.redis_db = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.redis_sentinel_service_name = mymaster {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.redis_server = localhost:6379 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.retry_attempts = 2 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.retry_delay = 0.0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.socket_keepalive_count = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.socket_keepalive_idle = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.socket_keepalive_interval = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.socket_timeout = 1.0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.tls_allowed_ciphers = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.tls_cafile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.tls_certfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.tls_enabled = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.tls_keyfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cache.username = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] coordination.backend_url = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.asyncio_connection = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.asyncio_slave_connection = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.backend = sqlalchemy {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.connection = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.connection_debug = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.connection_parameters = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.connection_recycle_time = 3600 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.connection_trace = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.db_inc_retry_interval = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.db_max_retries = 20 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.db_max_retry_interval = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.db_retry_interval = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.max_overflow = 50 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.max_pool_size = 5 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.max_retries = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.mysql_wsrep_sync_wait = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.pool_timeout = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.retry_interval = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.slave_connection = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.sqlite_synchronous = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.synchronous_reader = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] database.use_db_reconnect = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler.connection_string = messaging:// {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler.enabled = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler.es_doc_type = notification {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler.es_scroll_size = 10000 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler.es_scroll_time = 2m {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler.filter_error_trace = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler.hmac_keys = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler.sentinel_service_name = mymaster {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler.socket_timeout = 0.1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler.trace_requests = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler.trace_sqlalchemy = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler_jaeger.process_tags = {} {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler_jaeger.service_name_prefix = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] profiler_otlp.service_name_prefix = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_policy.enforce_new_defaults = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_policy.policy_default_rule = default {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_policy.policy_file = policy.yaml {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_policy.remote_timeout = 60.0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] privsep_osbrick.group = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] privsep_osbrick.helper_command = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] privsep_osbrick.user = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cinder_sys_admin.group = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cinder_sys_admin.helper_command = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] cinder_sys_admin.user = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] service_user.auth_section = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] service_user.auth_type = password {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] service_user.cafile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] service_user.certfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] service_user.collect_timing = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] service_user.insecure = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] service_user.keyfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] service_user.send_service_user_token = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] service_user.split_loggers = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] service_user.timeout = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance.auth_section = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance.auth_type = password {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance.certfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance.collect_timing = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance.insecure = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance.keyfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance.region_name = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance.split_loggers = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] glance.timeout = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.backend_availability_zone = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.chap_password = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.chap_username = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.disk_geometry = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.driver_client_cert = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.driver_client_cert_key = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.driver_data_namespace = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.driver_use_ssl = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.enable_unsupported_driver = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.extra_capabilities = {} {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.filter_function = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.goodness_function = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.iscsi_target_flags = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.iscsi_write_cache = on {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.iser_helper = tgtadm {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=89145) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 31 10:49:10 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.quobyte [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.iser_port = 3260 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nas_host = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nas_login = admin {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nas_mount_options = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.quobyte [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nas_password = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nas_private_key = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Running cmd (subprocess): mount.quobyte {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nas_share_path = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nas_ssh_port = 22 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.num_shell_tries = 3 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.nvmet_port_id = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.quobyte_client_cfg = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.quobyte_volume_url = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.replication_device = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.report_discard_supported = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.reserved_percentage = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.scst_target_driver = iscsi {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.scst_target_iqn_name = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.storage_protocol = iSCSI {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.target_helper = tgtadm {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.target_port = 3260 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.target_protocol = iscsi {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.trace_flags = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.unique_fqdn_network = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.use_chap_auth = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.volume_backend_name = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.volume_clear = zero {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.volume_clear_ionice = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.volume_clear_size = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_reports.file_event_handler = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_reports.log_dir = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.backend_availability_zone = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.backend_host = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.chap_password = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.chap_username = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.chiscsi_conf = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.disk_geometry = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.driver_client_cert = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.driver_client_cert_key = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.driver_data_namespace = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.driver_use_ssl = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.extra_capabilities = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.filter_function = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.goodness_function = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.iscsi_target_flags = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.iscsi_write_cache = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.iser_helper = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.iser_ip_address = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.iser_port = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.iser_target_prefix = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nas_host = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nas_login = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nas_mount_options = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nas_password = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nas_private_key = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nas_share_path = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nas_ssh_port = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.num_shell_tries = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nvmet_ns_id = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.nvmet_port_id = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.replication_device = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.report_discard_supported = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.reserved_percentage = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.scst_target_driver = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.storage_protocol = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.target_helper = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.target_ip_address = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.target_port = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.target_prefix = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.target_protocol = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.trace_flags = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.unique_fqdn_network = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.use_chap_auth = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.volume_clear = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.volume_clear_ionice = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.volume_clear_size = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] QuobyteHD.volumes_dir = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.ssl = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack quobyte-client[89146]: Reading configuration file: /etc/quobyte/client.cfg Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.ssl_version = {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_notifications.driver = [] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_notifications.retry = -1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack quobyte-client[89146]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] oslo_messaging_notifications.transport_url = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] key_manager.fixed_key = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.barbican_api_version = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.barbican_endpoint = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.barbican_endpoint_type = public {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.barbican_region_name = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.cafile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.certfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.collect_timing = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.insecure = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.keyfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.number_of_retries = 60 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.retry_delay = 1 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.send_service_user_token = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.split_loggers = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.timeout = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.verify_ssl = True {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican.verify_ssl_path = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican_service_user.auth_section = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican_service_user.auth_type = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican_service_user.cafile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican_service_user.certfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican_service_user.collect_timing = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican_service_user.insecure = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican_service_user.keyfile = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican_service_user.split_loggers = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] barbican_service_user.timeout = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.approle_role_id = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.approle_secret_id = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.auth_method = approle {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.auth_path = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.kv_mountpoint = secret {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.kv_path = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.kv_version = 2 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.namespace = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.root_token_id = **** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.ssl_ca_crt_file = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.timeout = 60.0 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.token_file = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.token_role = None {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.use_ssl = False {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:49:10 devstack cinder-volume[88831]: DEBUG oslo_service.backend._eventlet.service [None req-d2520f44-6eba-48d7-a29d-01ce9efb1d7d None None] ******************************************************************************** {{(pid=88831) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:10 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:49:10 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:10 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.241s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:10 devstack cinder-volume[89145]: INFO cinder.volume.driver [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Driver hasn't implemented _init_vendor_properties() Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.volume.driver [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6408653259277, 'free_capacity_gb': 1775.6408653259277, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89145) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_db.sqlalchemy.engines [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89145) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writer thread running {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.db.api [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Building query based on filter {{(pid=89145) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=89145) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:10 devstack cinder-volume[89145]: INFO cinder.keymgr.migration [None req-efb03dcf-9289-4f7a-b610-1843b711c2d6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 10:49:10 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:49:10 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:10 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.250s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Driver initialization completed successfully. Jul 31 10:49:10 devstack cinder-volume[89145]: INFO cinder.manager [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Initiating service 3 cleanup Jul 31 10:49:10 devstack cinder-volume[89145]: INFO cinder.manager [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Service 3 cleanup completed. Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.service [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Creating RPC server for service cinder-volume {{(pid=89145) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.service [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=89145) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 10:49:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:10 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:49:10 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:11 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.240s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:11 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-26c87ab8-9f4c-4f22-954f-2f9b210e8e44 None None] Driver post RPC initialization completed successfully. Jul 31 10:49:19 devstack cinder-volume[88831]: DEBUG dbcounter [-] [88831] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88831) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:49:20 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=2 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:49:21 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:50:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:50:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 6 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:50:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Flow 'volume_create_manager' (5fd4cc01-d822-4eda-82eb-96a89ee10aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d40c1e-e215-4929-8072-6061af62be9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d40c1e-e215-4929-8072-6061af62be9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-837714175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b0b59e-e3fb-4f62-9736-7936fd0d194f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf33bcb6ff645b182c7d937d011038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:15Z,use_quota=True,user_id='0d5555593bcf479ba7642eef3dc2edeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e4a8c0-8de7-4c29-b6ff-c6720b1269cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e4a8c0-8de7-4c29-b6ff-c6720b1269cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e5ab2e-8eac-4207-b411-61217d67fed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e5ab2e-8eac-4207-b411-61217d67fed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b0b59e-e3fb-4f62-9736-7936fd0d194f', 'volume_name': 'volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7649963f-f20e-46c8-9afc-61e85466eb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7649963f-f20e-46c8-9afc-61e85466eb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc574fb5-b9d1-4b81-ab75-41e51453278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:14 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Volume 62b0b59e-e3fb-4f62-9736-7936fd0d194f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f', 'volume_size': 1} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-837714175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b0b59e-e3fb-4f62-9736-7936fd0d194f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf33bcb6ff645b182c7d937d011038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:15Z,use_quota=True,user_id='0d5555593bcf479ba7642eef3dc2edeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Creating volume 62b0b59e-e3fb-4f62-9736-7936fd0d194f {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:50:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:50:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:50:15 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:50:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:15 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f 1073741824 Jul 31 10:50:15 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:17 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f 1073741824" returned: 0 in 2.020s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:17 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f Jul 31 10:50:17 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:18 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f" returned: 0 in 0.823s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:18 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] <== create_volume: return (3054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.064s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc574fb5-b9d1-4b81-ab75-41e51453278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e08044-101b-495e-93bf-9869543fec10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:18 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Volume volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f (62b0b59e-e3fb-4f62-9736-7936fd0d194f): created successfully Jul 31 10:50:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e08044-101b-495e-93bf-9869543fec10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Flow 'volume_create_manager' (5fd4cc01-d822-4eda-82eb-96a89ee10aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:18 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-0afd05c6-d5d1-494e-9d72-18030a690e76 tempest-DeleteServersTestJSON-2110323514 None] Created volume successfully. Jul 31 10:50:25 devstack cinder-volume[89145]: WARNING py.warnings [req-ef855b31-5316-48c4-be17-aa3321c7d211 req-c9d6eefb-1266-462a-a6ac-0ddbecb714c3 tempest-DeleteServersTestJSON-2110323514 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 31 10:50:25 devstack cinder-volume[89145]: .first() Jul 31 10:50:25 devstack cinder-volume[89145]: Jul 31 10:50:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-ef855b31-5316-48c4-be17-aa3321c7d211 req-c9d6eefb-1266-462a-a6ac-0ddbecb714c3 tempest-DeleteServersTestJSON-2110323514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-ef855b31-5316-48c4-be17-aa3321c7d211 req-c9d6eefb-1266-462a-a6ac-0ddbecb714c3 tempest-DeleteServersTestJSON-2110323514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:25 devstack cinder-volume[89145]: INFO oslo.privsep.daemon [req-ef855b31-5316-48c4-be17-aa3321c7d211 req-c9d6eefb-1266-462a-a6ac-0ddbecb714c3 tempest-DeleteServersTestJSON-2110323514 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5qk0unje/privsep.sock'] Jul 31 10:50:25 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5qk0unje/privsep.sock Jul 31 10:50:25 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:26 devstack cinder-volume[89145]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 31 10:50:26 devstack cinder-volume[89145]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 10:50:26 devstack cinder-volume[89145]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 31 10:50:26 devstack cinder-volume[89145]: WARNING oslo.privsep.daemon [-] privsep log: Jul 31 10:50:26 devstack cinder-volume[89145]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 31 10:50:26 devstack cinder-volume[89145]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 31 10:50:26 devstack cinder-volume[89145]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 10:50:26 devstack cinder-volume[89145]: WARNING oslo.privsep.daemon [-] privsep log: Jul 31 10:50:26 devstack cinder-volume[89145]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 31 10:50:26 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:26 devstack cinder-volume[89145]: INFO oslo.privsep.daemon [req-ef855b31-5316-48c4-be17-aa3321c7d211 req-c9d6eefb-1266-462a-a6ac-0ddbecb714c3 tempest-DeleteServersTestJSON-2110323514 None] Spawned new privsep daemon via rootwrap Jul 31 10:50:26 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [req-ef855b31-5316-48c4-be17-aa3321c7d211 req-c9d6eefb-1266-462a-a6ac-0ddbecb714c3 tempest-DeleteServersTestJSON-2110323514 None] Accepted privsep connection to /tmp/tmp5qk0unje/privsep.sock {{(pid=89145) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 31 10:50:26 devstack cinder-volume[89145]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 31 10:50:26 devstack cinder-volume[89145]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 31 10:50:26 devstack cinder-volume[89145]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 31 10:50:26 devstack cinder-volume[89145]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90199 Jul 31 10:50:26 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8fc4ff-ce3d-4269-9b0c-09d32ca1e7eb]: (2,) {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:26 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c9a387-0fb8-42ac-b69b-e3dc320aeb45]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-ef855b31-5316-48c4-be17-aa3321c7d211 req-c9d6eefb-1266-462a-a6ac-0ddbecb714c3 tempest-DeleteServersTestJSON-2110323514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:26 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f Jul 31 10:50:26 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:27 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-ef855b31-5316-48c4-be17-aa3321c7d211 req-c9d6eefb-1266-462a-a6ac-0ddbecb714c3 tempest-DeleteServersTestJSON-2110323514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f" returned: 0 in 0.602s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-ef855b31-5316-48c4-be17-aa3321c7d211 req-c9d6eefb-1266-462a-a6ac-0ddbecb714c3 tempest-DeleteServersTestJSON-2110323514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.251s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ef855b31-5316-48c4-be17-aa3321c7d211 req-c9d6eefb-1266-462a-a6ac-0ddbecb714c3 tempest-DeleteServersTestJSON-2110323514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd96ec10a-05ff-41d0-b166-5851890e4ad3', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:50:27 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-ef855b31-5316-48c4-be17-aa3321c7d211 req-c9d6eefb-1266-462a-a6ac-0ddbecb714c3 tempest-DeleteServersTestJSON-2110323514 None] attachment_update completed successfully. Jul 31 10:50:32 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-13652a48-8075-4ecb-8fd2-0b52276e630f req-76c9c9eb-f5e4-484b-8224-418dd0a6949b tempest-DeleteServersTestJSON-2110323514 None] Terminate volume connection completed successfully. Jul 31 10:50:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-13652a48-8075-4ecb-8fd2-0b52276e630f req-76c9c9eb-f5e4-484b-8224-418dd0a6949b tempest-DeleteServersTestJSON-2110323514 None] Deleting attachment d96ec10a-05ff-41d0-b166-5851890e4ad3. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:50:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Acquiring lock "cinder-62b0b59e-e3fb-4f62-9736-7936fd0d194f-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Lock "cinder-62b0b59e-e3fb-4f62-9736-7936fd0d194f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Acquiring lock "cinder-quobyte-62b0b59e-e3fb-4f62-9736-7936fd0d194f" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:50:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Lock "cinder-quobyte-62b0b59e-e3fb-4f62-9736-7936fd0d194f" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:50:33 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[848c90e9-eb97-4df5-ac58-b3aeafe131ff]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:33 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f Jul 31 10:50:33 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:34 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f" returned: 0 in 0.397s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:34 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f Jul 31 10:50:34 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:34 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-62b0b59e-e3fb-4f62-9736-7936fd0d194f" returned: 0 in 0.284s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Lock "cinder-quobyte-62b0b59e-e3fb-4f62-9736-7936fd0d194f" released by "delete_volume" :: held 0.733s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:34 devstack cinder-volume[89145]: WARNING cinder.quota [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:50:34 devstack cinder-volume[89145]: WARNING cinder.quota [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Created reservations ['118970cd-6efa-4ff3-8a37-70b1fa0eb672', '12af353a-1236-404c-b269-b8f94e59cde5', 'fed54e9c-4d79-49e5-ac4c-13897dfaa106', '9c80cafc-04fd-4ae9-a820-e238766d761f'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:34 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:50:34 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:34 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.257s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:34 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Deleted volume successfully. Jul 31 10:50:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e6c5151-c009-43ba-a09e-a2958fdb5ce5 tempest-DeleteServersTestJSON-2110323514 None] Lock "cinder-62b0b59e-e3fb-4f62-9736-7936fd0d194f-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Flow 'volume_create_manager' (31e96077-7720-4527-857f-2134753d49c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b309b610-873d-4826-b456-14797065992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b309b610-873d-4826-b456-14797065992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1317215680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f290bb-f4ad-4f6b-834c-c60ee20d31a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dea011011024846ad4db65e76adb70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:41Z,use_quota=True,user_id='b41a9ba3771a4a40b21a396e3d8b963b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b55c726-4337-4398-ab2a-f5bc9a23e1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b55c726-4337-4398-ab2a-f5bc9a23e1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c780781-df62-45b9-bed1-54073038475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c780781-df62-45b9-bed1-54073038475c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7f290bb-f4ad-4f6b-834c-c60ee20d31a0', 'volume_name': 'volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e096c1b-840e-430d-aabc-951c009dc21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e096c1b-840e-430d-aabc-951c009dc21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5d5369-936c-4396-96e2-52584d06c34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:40 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Volume d7f290bb-f4ad-4f6b-834c-c60ee20d31a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0', 'volume_size': 1} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1317215680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f290bb-f4ad-4f6b-834c-c60ee20d31a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dea011011024846ad4db65e76adb70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:41Z,use_quota=True,user_id='b41a9ba3771a4a40b21a396e3d8b963b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Creating volume d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:50:40 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:50:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:40 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 1073741824 Jul 31 10:50:40 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:41 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 1073741824" returned: 0 in 0.733s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:41 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 Jul 31 10:50:41 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:42 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0" returned: 0 in 0.343s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5d5369-936c-4396-96e2-52584d06c34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f283ea80-71b4-4328-bae5-fb82c9efd22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:42 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Volume volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 (d7f290bb-f4ad-4f6b-834c-c60ee20d31a0): created successfully Jul 31 10:50:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f283ea80-71b4-4328-bae5-fb82c9efd22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Flow 'volume_create_manager' (31e96077-7720-4527-857f-2134753d49c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c99c2b5d-297a-4ebe-89f6-f88fd018377a tempest-ServerActionsTestOtherA-900741309 None] Created volume successfully. Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Flow 'volume_create_manager' (af14200e-6013-4b48-aeab-583eefbd9c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a287bf86-5755-4696-a50a-95b5677b072e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a287bf86-5755-4696-a50a-95b5677b072e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-883500421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d4a803-635e-45b5-a8d6-297d8430920d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63f914cdd294f4da20f801ed8d60eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:44Z,use_quota=True,user_id='509f76f93f2f45c29edae17a880acc13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50dd1e6e-24ce-4dda-a683-235f4f3dd31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50dd1e6e-24ce-4dda-a683-235f4f3dd31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e68dda-a358-4145-898b-eaa70b85b164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e68dda-a358-4145-898b-eaa70b85b164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d4a803-635e-45b5-a8d6-297d8430920d', 'volume_name': 'volume-17d4a803-635e-45b5-a8d6-297d8430920d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb8d113-907f-4945-8c6f-102338108545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb8d113-907f-4945-8c6f-102338108545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0693096b-8ca5-41e4-8bbf-66ed00163ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:44 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Volume 17d4a803-635e-45b5-a8d6-297d8430920d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d4a803-635e-45b5-a8d6-297d8430920d', 'volume_size': 1} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-883500421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d4a803-635e-45b5-a8d6-297d8430920d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b63f914cdd294f4da20f801ed8d60eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:44Z,use_quota=True,user_id='509f76f93f2f45c29edae17a880acc13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Creating volume 17d4a803-635e-45b5-a8d6-297d8430920d {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:50:44 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:50:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d4a803-635e-45b5-a8d6-297d8430920d 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:44 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d4a803-635e-45b5-a8d6-297d8430920d 1073741824 Jul 31 10:50:44 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:45 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d4a803-635e-45b5-a8d6-297d8430920d 1073741824" returned: 0 in 0.604s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d4a803-635e-45b5-a8d6-297d8430920d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:45 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d4a803-635e-45b5-a8d6-297d8430920d Jul 31 10:50:45 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:45 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d4a803-635e-45b5-a8d6-297d8430920d" returned: 0 in 0.310s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0693096b-8ca5-41e4-8bbf-66ed00163ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d4a803-635e-45b5-a8d6-297d8430920d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d7d9ee5-f603-42d4-96ee-1c4a93ed8091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:45 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Volume volume-17d4a803-635e-45b5-a8d6-297d8430920d (17d4a803-635e-45b5-a8d6-297d8430920d): created successfully Jul 31 10:50:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d7d9ee5-f603-42d4-96ee-1c4a93ed8091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Flow 'volume_create_manager' (af14200e-6013-4b48-aeab-583eefbd9c2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8c1c220a-7278-4178-be68-3ce215645504 tempest-AttachVolumeShelveTestJSON-76882772 None] Created volume successfully. Jul 31 10:50:50 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f5e9814c-be35-4984-94f7-927e9d27c70c tempest-GroupSnapshotsV319Test-1045187168 None] Group tempest-GroupSnapshotsV319Test-Group-1638028748: creating Jul 31 10:50:50 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f5e9814c-be35-4984-94f7-927e9d27c70c tempest-GroupSnapshotsV319Test-1045187168 None] Group tempest-GroupSnapshotsV319Test-Group-1638028748: created successfully Jul 31 10:50:50 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f5e9814c-be35-4984-94f7-927e9d27c70c tempest-GroupSnapshotsV319Test-1045187168 None] Create group completed successfully. Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Flow 'volume_create_manager' (8b0cbe83-600c-4a11-b8fc-d7cc544469e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c723c7-d504-49d5-a04f-fada616f328a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c723c7-d504-49d5-a04f-fada616f328a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1795481669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29ecfdef-b0a9-4ab5-94df-b63dbf47c155,host='devstack@QuobyteHD#QuobyteHD',id=3ac574ef-7e61-40b0-a372-ee8c67135e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1eccc5ddca64f3481d612d7f973dc3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:53Z,use_quota=True,user_id='0bdfae682f0342d9b5afd25aea0a1f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5c2c108-1090-4ff9-8faa-cda1094bf0bb),volume_type_id=d5c2c108-1090-4ff9-8faa-cda1094bf0bb)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3851a8d-b1e8-4d53-985a-181c2daae55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3851a8d-b1e8-4d53-985a-181c2daae55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066a4f0c-6abc-4576-97ae-c2eb941983a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066a4f0c-6abc-4576-97ae-c2eb941983a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac574ef-7e61-40b0-a372-ee8c67135e50', 'volume_name': 'volume-3ac574ef-7e61-40b0-a372-ee8c67135e50', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784b0cd3-ba5a-425c-8f89-4963affd8b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784b0cd3-ba5a-425c-8f89-4963affd8b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e72b67-5e7f-4645-9cb8-6159301a96ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:53 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Volume 3ac574ef-7e61-40b0-a372-ee8c67135e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac574ef-7e61-40b0-a372-ee8c67135e50', 'volume_size': 1} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29ecfdef-b0a9-4ab5-94df-b63dbf47c155,created_at=2026-07-31T08:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1795481669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29ecfdef-b0a9-4ab5-94df-b63dbf47c155,host='devstack@QuobyteHD#QuobyteHD',id=3ac574ef-7e61-40b0-a372-ee8c67135e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1eccc5ddca64f3481d612d7f973dc3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:50:53Z,use_quota=True,user_id='0bdfae682f0342d9b5afd25aea0a1f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5c2c108-1090-4ff9-8faa-cda1094bf0bb),volume_type_id=d5c2c108-1090-4ff9-8faa-cda1094bf0bb)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Creating volume 3ac574ef-7e61-40b0-a372-ee8c67135e50 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:50:53 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:50:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:53 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 1073741824 Jul 31 10:50:53 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:54 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 1073741824" returned: 0 in 0.872s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:54 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 Jul 31 10:50:54 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:54 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50" returned: 0 in 0.380s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:50:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e72b67-5e7f-4645-9cb8-6159301a96ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac574ef-7e61-40b0-a372-ee8c67135e50', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849f30c0-d325-45a8-86d1-3e0af1c99684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:50:54 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Volume volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 (3ac574ef-7e61-40b0-a372-ee8c67135e50): created successfully Jul 31 10:50:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849f30c0-d325-45a8-86d1-3e0af1c99684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:50:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Flow 'volume_create_manager' (8b0cbe83-600c-4a11-b8fc-d7cc544469e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:50:54 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-05c68059-6cfb-486b-8e30-d75169371b28 tempest-GroupSnapshotsV319Test-1045187168 None] Created volume successfully. Jul 31 10:50:56 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] GroupSnapshot 26b506f7-2a12-43ab-956f-8e79762c0f70: creating. Jul 31 10:50:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] Group snapshot 26b506f7-2a12-43ab-956f-8e79762c0f70: creating. {{(pid=89145) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 10:50:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] Creating offline snapshot cfc06a83-4081-46ca-9793-db2ce35c3c4c of volume 3ac574ef-7e61-40b0-a372-ee8c67135e50 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:50:56 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[25032464-56e7-425a-a5b8-3804271d02d2]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:50:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:57 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 Jul 31 10:50:57 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:57 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50" returned: 0 in 0.505s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:57 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c 1G Jul 31 10:50:57 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:58 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c 1G" returned: 0 in 0.687s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:58 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c Jul 31 10:50:58 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:58 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c" returned: 0 in 0.449s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:58 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:50:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:58 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c Jul 31 10:50:58 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:59 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c" returned: 0 in 0.721s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:59 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.info Jul 31 10:50:59 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:00 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.info" returned: 0 in 0.659s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:00 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:51:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:00 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.info Jul 31 10:51:00 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:00 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.info" returned: 0 in 0.552s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.718s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:00 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-16521085-fff4-408b-b19d-34637f63b2fb tempest-GroupSnapshotsV319Test-1045187168 None] group_snapshot 26b506f7-2a12-43ab-956f-8e79762c0f70: created successfully Jul 31 10:51:01 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] group_snapshot 26b506f7-2a12-43ab-956f-8e79762c0f70: deleting Jul 31 10:51:01 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] group_snapshot 26b506f7-2a12-43ab-956f-8e79762c0f70: deleting {{(pid=89145) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 10:51:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Acquiring lock "cinder-quobyte-3ac574ef-7e61-40b0-a372-ee8c67135e50" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Lock "cinder-quobyte-3ac574ef-7e61-40b0-a372-ee8c67135e50" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Acquiring lock "cinder-quobyte-cfc06a83-4081-46ca-9793-db2ce35c3c4c" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Lock "cinder-quobyte-cfc06a83-4081-46ca-9793-db2ce35c3c4c" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Deleting offline snapshot cfc06a83-4081-46ca-9793-db2ce35c3c4c of volume 3ac574ef-7e61-40b0-a372-ee8c67135e50 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:51:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] snapshot_file for this snap is: volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:51:02 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa942138-96c0-4814-b9c4-18f534c8a6c6]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:02 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c Jul 31 10:51:02 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:02 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c" returned: 0 in 0.761s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ac574ef-7e61-40b0-a372-ee8c67135e50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:51:02 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfe7f44-1751-4d75-936f-a69adc3c7d55]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:03 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 Jul 31 10:51:03 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:03 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50" returned: 0 in 0.879s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:03 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c Jul 31 10:51:03 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-517cf86d-54bb-432d-8295-5e33f0c06de8 req-08ce7169-02bb-4585-b870-221325995ffb tempest-AttachVolumeShelveTestJSON-76882772 None] No connector for attachment a83cfa22-8e94-41ef-b3c4-94a491925040; skipping storage backend terminate_connection call. {{(pid=89145) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 31 10:51:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-517cf86d-54bb-432d-8295-5e33f0c06de8 req-08ce7169-02bb-4585-b870-221325995ffb tempest-AttachVolumeShelveTestJSON-76882772 None] Deleting attachment a83cfa22-8e94-41ef-b3c4-94a491925040. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:51:04 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c" returned: 0 in 0.565s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:04 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c Jul 31 10:51:04 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:04 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50.cfc06a83-4081-46ca-9793-db2ce35c3c4c" returned: 0 in 0.383s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Lock "cinder-quobyte-cfc06a83-4081-46ca-9793-db2ce35c3c4c" released by "_delete_snapshot" :: held 2.818s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Lock "cinder-quobyte-3ac574ef-7e61-40b0-a372-ee8c67135e50" released by "delete_snapshot" :: held 2.868s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:04 devstack cinder-volume[89145]: WARNING cinder.quota [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-919465709 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-919465709, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:51:04 devstack cinder-volume[89145]: WARNING cinder.quota [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-919465709 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-919465709, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:51:04 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] Created reservations ['70eaa705-760f-495e-b64d-b00bb239eda4', 'b2aa644b-18b7-4c7e-872f-1aa9b836773f', '68cf6d4d-044a-4375-833b-a0e70aab1e73', '039689fc-7bd5-452e-90b8-635e5bd7ddf4'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:51:05 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-effa21c7-8201-4a73-a324-426bf80d11ab tempest-GroupSnapshotsV319Test-1045187168 None] group_snapshot 26b506f7-2a12-43ab-956f-8e79762c0f70: deleted successfully Jul 31 10:51:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Acquiring lock "cinder-quobyte-3ac574ef-7e61-40b0-a372-ee8c67135e50" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Lock "cinder-quobyte-3ac574ef-7e61-40b0-a372-ee8c67135e50" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:06 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cf8429-83ce-44ac-9d06-9a15a1d2f734]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:06 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 Jul 31 10:51:06 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:06 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50" returned: 0 in 0.698s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:07 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50 Jul 31 10:51:07 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:07 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac574ef-7e61-40b0-a372-ee8c67135e50" returned: 0 in 0.388s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:07 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Lock "cinder-quobyte-3ac574ef-7e61-40b0-a372-ee8c67135e50" released by "delete_volume" :: held 1.191s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:07 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Created reservations ['d812aa88-780e-489a-9b57-11732d308792'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:51:07 devstack cinder-volume[89145]: WARNING cinder.quota [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-919465709 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-919465709, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:51:07 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Created reservations ['3f4821a1-3638-419a-9b97-3bc1d7c46878', '43f6b6d3-1f9b-41cd-ade1-f5011ac84188', '56d2fe6d-b95f-43b8-a5fe-1b17b22b0d23', 'e55b8ce3-f2f6-4bdb-bd46-feb870823573'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:51:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:51:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:51:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:07 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:51:07 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:08 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.271s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:51:08 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-83491e44-99c7-4c1b-ad63-dfc1908f14d6 tempest-GroupSnapshotsV319Test-1045187168 None] Delete group completed successfully. Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:08 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:51:08 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:08 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.316s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 8 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:51:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:51:11 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=41,cinder:UPDATE=43,cinder:INSERT=11,cinder:DELETE=5 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:51:21 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=46,cinder:UPDATE=41,cinder:INSERT=7 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:51:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-23e526b8-6147-4c95-9108-e86ee3413f67 req-9ce63eba-4e41-457c-b1b7-44f870e2481c tempest-ServerActionsTestOtherA-900741309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-23e526b8-6147-4c95-9108-e86ee3413f67 req-9ce63eba-4e41-457c-b1b7-44f870e2481c tempest-ServerActionsTestOtherA-900741309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:24 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a18903e-db46-4464-8660-c95a90e21e30]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-23e526b8-6147-4c95-9108-e86ee3413f67 req-9ce63eba-4e41-457c-b1b7-44f870e2481c tempest-ServerActionsTestOtherA-900741309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:25 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 Jul 31 10:51:25 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:25 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-23e526b8-6147-4c95-9108-e86ee3413f67 req-9ce63eba-4e41-457c-b1b7-44f870e2481c tempest-ServerActionsTestOtherA-900741309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0" returned: 0 in 0.537s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-23e526b8-6147-4c95-9108-e86ee3413f67 req-9ce63eba-4e41-457c-b1b7-44f870e2481c tempest-ServerActionsTestOtherA-900741309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.564s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-23e526b8-6147-4c95-9108-e86ee3413f67 req-9ce63eba-4e41-457c-b1b7-44f870e2481c tempest-ServerActionsTestOtherA-900741309 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c4ace29-a435-4829-9dbf-0898ae9fadd5', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:51:25 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-23e526b8-6147-4c95-9108-e86ee3413f67 req-9ce63eba-4e41-457c-b1b7-44f870e2481c tempest-ServerActionsTestOtherA-900741309 None] attachment_update completed successfully. Jul 31 10:51:31 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-c3e3fdc9-6b07-4444-b4e4-0ee3ab75d13a req-3bc63678-b155-45d7-9601-b30e1217a34a tempest-ServerActionsTestOtherA-900741309 None] Terminate volume connection completed successfully. Jul 31 10:51:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-c3e3fdc9-6b07-4444-b4e4-0ee3ab75d13a req-3bc63678-b155-45d7-9601-b30e1217a34a tempest-ServerActionsTestOtherA-900741309 None] Deleting attachment 1c4ace29-a435-4829-9dbf-0898ae9fadd5. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:51:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-c3e3fdc9-6b07-4444-b4e4-0ee3ab75d13a req-7a0e3622-3010-4f6c-af17-427f1dc937ac tempest-ServerActionsTestOtherA-900741309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-c3e3fdc9-6b07-4444-b4e4-0ee3ab75d13a req-7a0e3622-3010-4f6c-af17-427f1dc937ac tempest-ServerActionsTestOtherA-900741309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:33 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2164861c-b2b7-466e-ac0f-17a38024993b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-c3e3fdc9-6b07-4444-b4e4-0ee3ab75d13a req-7a0e3622-3010-4f6c-af17-427f1dc937ac tempest-ServerActionsTestOtherA-900741309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:33 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 Jul 31 10:51:33 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:33 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-c3e3fdc9-6b07-4444-b4e4-0ee3ab75d13a req-7a0e3622-3010-4f6c-af17-427f1dc937ac tempest-ServerActionsTestOtherA-900741309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0" returned: 0 in 0.505s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-c3e3fdc9-6b07-4444-b4e4-0ee3ab75d13a req-7a0e3622-3010-4f6c-af17-427f1dc937ac tempest-ServerActionsTestOtherA-900741309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.552s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-c3e3fdc9-6b07-4444-b4e4-0ee3ab75d13a req-7a0e3622-3010-4f6c-af17-427f1dc937ac tempest-ServerActionsTestOtherA-900741309 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42289d54-4bfa-49a2-b92b-e790c39ae0d2', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:51:33 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-c3e3fdc9-6b07-4444-b4e4-0ee3ab75d13a req-7a0e3622-3010-4f6c-af17-427f1dc937ac tempest-ServerActionsTestOtherA-900741309 None] attachment_update completed successfully. Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Flow 'volume_create_manager' (a76bd035-3373-4c81-92b5-a284d3f12e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da21ce25-2b14-4b7b-8889-40a87909ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da21ce25-2b14-4b7b-8889-40a87909ab71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-704772375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3154c0a-874d-42a1-80ba-38c158c88eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c40b6fccc0d4a36b046bb6cd8744d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:42Z,use_quota=True,user_id='705d0b6ab0e94174be9bf39bac9224cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7872eff-6e28-44d0-92fb-40ebddc8e424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7872eff-6e28-44d0-92fb-40ebddc8e424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9661425d-22b9-4690-980a-81ef3cfe2ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9661425d-22b9-4690-980a-81ef3cfe2ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3154c0a-874d-42a1-80ba-38c158c88eb0', 'volume_name': 'volume-e3154c0a-874d-42a1-80ba-38c158c88eb0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d284769-5adc-4fe0-a85b-855661001493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d284769-5adc-4fe0-a85b-855661001493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9320f8ea-6548-499b-9b66-debddcb52ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:42 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Volume e3154c0a-874d-42a1-80ba-38c158c88eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3154c0a-874d-42a1-80ba-38c158c88eb0', 'volume_size': 1} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-704772375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3154c0a-874d-42a1-80ba-38c158c88eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c40b6fccc0d4a36b046bb6cd8744d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:42Z,use_quota=True,user_id='705d0b6ab0e94174be9bf39bac9224cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Creating volume e3154c0a-874d-42a1-80ba-38c158c88eb0 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:51:42 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:51:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e3154c0a-874d-42a1-80ba-38c158c88eb0 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:42 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e3154c0a-874d-42a1-80ba-38c158c88eb0 1073741824 Jul 31 10:51:42 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:43 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e3154c0a-874d-42a1-80ba-38c158c88eb0 1073741824" returned: 0 in 0.607s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e3154c0a-874d-42a1-80ba-38c158c88eb0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:43 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e3154c0a-874d-42a1-80ba-38c158c88eb0 Jul 31 10:51:43 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:43 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e3154c0a-874d-42a1-80ba-38c158c88eb0" returned: 0 in 0.550s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:43 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:51:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9320f8ea-6548-499b-9b66-debddcb52ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3154c0a-874d-42a1-80ba-38c158c88eb0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced446eb-7722-4634-9549-548713291aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:43 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Volume volume-e3154c0a-874d-42a1-80ba-38c158c88eb0 (e3154c0a-874d-42a1-80ba-38c158c88eb0): created successfully Jul 31 10:51:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced446eb-7722-4634-9549-548713291aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Flow 'volume_create_manager' (a76bd035-3373-4c81-92b5-a284d3f12e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:44 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1fbd2ae7-6078-4bed-a109-06563823ccf0 tempest-VolumesAdminNegativeTest-251639470 None] Created volume successfully. Jul 31 10:51:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Acquiring lock "cinder-e3154c0a-874d-42a1-80ba-38c158c88eb0-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Lock "cinder-e3154c0a-874d-42a1-80ba-38c158c88eb0-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Acquiring lock "cinder-quobyte-e3154c0a-874d-42a1-80ba-38c158c88eb0" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Lock "cinder-quobyte-e3154c0a-874d-42a1-80ba-38c158c88eb0" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d6d94f-a452-4081-8b2a-1ace487fc8b2]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e3154c0a-874d-42a1-80ba-38c158c88eb0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:46 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e3154c0a-874d-42a1-80ba-38c158c88eb0 Jul 31 10:51:46 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:47 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e3154c0a-874d-42a1-80ba-38c158c88eb0" returned: 0 in 0.910s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e3154c0a-874d-42a1-80ba-38c158c88eb0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:47 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e3154c0a-874d-42a1-80ba-38c158c88eb0 Jul 31 10:51:47 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:48 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e3154c0a-874d-42a1-80ba-38c158c88eb0" returned: 0 in 0.716s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Lock "cinder-quobyte-e3154c0a-874d-42a1-80ba-38c158c88eb0" released by "delete_volume" :: held 1.738s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:48 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Created reservations ['a56913b4-aa85-4b57-b86b-ce91ac6c38f9', '3a3abfeb-312d-4778-b93f-2adada6b8377', '045dcb77-0e37-47e8-aef7-5643797b9d78', '9d17291d-914b-4950-af55-798783baf90f'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:51:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:51:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:51:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:48 devstack sudo[92327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:51:48 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:49 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.652s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:49 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:51:49 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Deleted volume successfully. Jul 31 10:51:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dc60664-6bae-455f-b391-3e2289ef43df tempest-VolumesAdminNegativeTest-251639470 None] Lock "cinder-e3154c0a-874d-42a1-80ba-38c158c88eb0-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Acquiring lock "cinder-17d4a803-635e-45b5-a8d6-297d8430920d-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Lock "cinder-17d4a803-635e-45b5-a8d6-297d8430920d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Acquiring lock "cinder-quobyte-17d4a803-635e-45b5-a8d6-297d8430920d" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:51:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Lock "cinder-quobyte-17d4a803-635e-45b5-a8d6-297d8430920d" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:51:52 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e46bd0-66b7-4569-887f-5139a5d5bd1f]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:51:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d4a803-635e-45b5-a8d6-297d8430920d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:52 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d4a803-635e-45b5-a8d6-297d8430920d Jul 31 10:51:52 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:53 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d4a803-635e-45b5-a8d6-297d8430920d" returned: 0 in 0.537s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d4a803-635e-45b5-a8d6-297d8430920d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:53 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d4a803-635e-45b5-a8d6-297d8430920d Jul 31 10:51:53 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:53 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d4a803-635e-45b5-a8d6-297d8430920d" returned: 0 in 0.317s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Lock "cinder-quobyte-17d4a803-635e-45b5-a8d6-297d8430920d" released by "delete_volume" :: held 0.941s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:51:53 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Created reservations ['c9e16436-ef29-48f6-81ea-6f56124bb22b', '8b219469-4631-4696-b777-090dafe6a6ec', '4b214ffb-cb60-4a41-9d57-a9ea4a31d9be', 'a66df3cd-5a01-4aff-83fe-5b75a513f046'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:51:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:51:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:51:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:53 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:51:53 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:54 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.276s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:54 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:51:54 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Deleted volume successfully. Jul 31 10:51:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-93ce0238-7e1b-4821-8a8d-74a7366a1e12 tempest-AttachVolumeShelveTestJSON-76882772 None] Lock "cinder-17d4a803-635e-45b5-a8d6-297d8430920d-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:03 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=27,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:52:04 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=21,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=3 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Flow 'volume_create_manager' (7f9d3188-02f7-44ea-a0d0-e471dc105f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9e5f59-e8b5-4b67-9e16-1a7ed36070aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9e5f59-e8b5-4b67-9e16-1a7ed36070aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-751420414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639f5d3b-dbbd-4afd-b11e-22b713d241c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b23ca4d70e490fbff2f11d43a80c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:05Z,use_quota=True,user_id='8cb6f082b9c9411aa6e8a1d20bd4cb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8edf54e-eec8-4ecd-8180-b1b335c37f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8edf54e-eec8-4ecd-8180-b1b335c37f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27108c6-dab1-4957-92fb-4bb64774c85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27108c6-dab1-4957-92fb-4bb64774c85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639f5d3b-dbbd-4afd-b11e-22b713d241c9', 'volume_name': 'volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0603a4e4-4a4f-4d05-a7cb-d9da771658c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0603a4e4-4a4f-4d05-a7cb-d9da771658c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d2e9f2-a974-4448-b9ef-8e79bbd51b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Volume 639f5d3b-dbbd-4afd-b11e-22b713d241c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9', 'volume_size': 1} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-751420414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639f5d3b-dbbd-4afd-b11e-22b713d241c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b23ca4d70e490fbff2f11d43a80c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:05Z,use_quota=True,user_id='8cb6f082b9c9411aa6e8a1d20bd4cb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Creating volume 639f5d3b-dbbd-4afd-b11e-22b713d241c9 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:52:05 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:05 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9 1073741824 Jul 31 10:52:05 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:05 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9 1073741824" returned: 0 in 0.539s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:05 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9 Jul 31 10:52:05 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:06 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9" returned: 0 in 0.264s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:52:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d2e9f2-a974-4448-b9ef-8e79bbd51b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faea5741-ae1a-47a6-aa79-bb678732cea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:06 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Volume volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9 (639f5d3b-dbbd-4afd-b11e-22b713d241c9): created successfully Jul 31 10:52:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faea5741-ae1a-47a6-aa79-bb678732cea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Flow 'volume_create_manager' (7f9d3188-02f7-44ea-a0d0-e471dc105f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:06 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b0aff847-fb7c-48a4-bf8d-148ff3beb535 tempest-VolumesListAdminTestJSON-125489345 None] Created volume successfully. Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Flow 'volume_create_manager' (50b879e5-d856-47fa-8232-55be921ca5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756c1861-a182-4d0c-8cae-c61d25c25ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756c1861-a182-4d0c-8cae-c61d25c25ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-504322711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c60469-9233-40a4-af31-dffaf334c5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b23ca4d70e490fbff2f11d43a80c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:08Z,use_quota=True,user_id='8cb6f082b9c9411aa6e8a1d20bd4cb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41527039-975c-440a-9c0d-4c51cea4e67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41527039-975c-440a-9c0d-4c51cea4e67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13151cc7-6531-4cdf-a4a9-8807a749d565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13151cc7-6531-4cdf-a4a9-8807a749d565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c60469-9233-40a4-af31-dffaf334c5cd', 'volume_name': 'volume-90c60469-9233-40a4-af31-dffaf334c5cd', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5101484c-03bc-4394-80e5-196443797d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5101484c-03bc-4394-80e5-196443797d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d6df25-0d9e-4f9e-9f5c-ae3ed3c91b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:07 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Volume 90c60469-9233-40a4-af31-dffaf334c5cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c60469-9233-40a4-af31-dffaf334c5cd', 'volume_size': 1} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-504322711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c60469-9233-40a4-af31-dffaf334c5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b23ca4d70e490fbff2f11d43a80c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:08Z,use_quota=True,user_id='8cb6f082b9c9411aa6e8a1d20bd4cb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Creating volume 90c60469-9233-40a4-af31-dffaf334c5cd {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:52:07 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:52:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-90c60469-9233-40a4-af31-dffaf334c5cd 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:07 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-90c60469-9233-40a4-af31-dffaf334c5cd 1073741824 Jul 31 10:52:07 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:08 devstack sudo[92454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:52:08 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:08 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.339s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 8 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:52:08 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-90c60469-9233-40a4-af31-dffaf334c5cd 1073741824" returned: 0 in 0.640s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-90c60469-9233-40a4-af31-dffaf334c5cd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:08 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-90c60469-9233-40a4-af31-dffaf334c5cd Jul 31 10:52:08 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:08 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-90c60469-9233-40a4-af31-dffaf334c5cd" returned: 0 in 0.288s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d6df25-0d9e-4f9e-9f5c-ae3ed3c91b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c60469-9233-40a4-af31-dffaf334c5cd', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da7ef3c-0ea6-4511-a053-d4c29d17ec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:08 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Volume volume-90c60469-9233-40a4-af31-dffaf334c5cd (90c60469-9233-40a4-af31-dffaf334c5cd): created successfully Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da7ef3c-0ea6-4511-a053-d4c29d17ec50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Flow 'volume_create_manager' (50b879e5-d856-47fa-8232-55be921ca5eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:08 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-bbb775fb-230c-40e7-beed-3dffd9432b1a tempest-VolumesListAdminTestJSON-125489345 None] Created volume successfully. Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Flow 'volume_create_manager' (adc35159-fc4e-42e7-ba36-4697326868b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad70c938-a545-4959-bc67-4fa47912b4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad70c938-a545-4959-bc67-4fa47912b4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-703553721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5515665a-fef9-442d-85b7-8cecdf107236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b23ca4d70e490fbff2f11d43a80c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:10Z,use_quota=True,user_id='8cb6f082b9c9411aa6e8a1d20bd4cb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f61d11f-2822-483f-8563-ddbca0d319f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f61d11f-2822-483f-8563-ddbca0d319f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef41a998-41cb-45bf-81d0-a7425da1bbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef41a998-41cb-45bf-81d0-a7425da1bbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5515665a-fef9-442d-85b7-8cecdf107236', 'volume_name': 'volume-5515665a-fef9-442d-85b7-8cecdf107236', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb572a71-ac2f-4014-96e7-7aebf9d21733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb572a71-ac2f-4014-96e7-7aebf9d21733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19038f28-5193-4bf4-abd2-f76267d4f927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:10 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Volume 5515665a-fef9-442d-85b7-8cecdf107236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5515665a-fef9-442d-85b7-8cecdf107236', 'volume_size': 1} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-703553721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5515665a-fef9-442d-85b7-8cecdf107236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b23ca4d70e490fbff2f11d43a80c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:10Z,use_quota=True,user_id='8cb6f082b9c9411aa6e8a1d20bd4cb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Creating volume 5515665a-fef9-442d-85b7-8cecdf107236 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:52:10 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:52:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5515665a-fef9-442d-85b7-8cecdf107236 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:10 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5515665a-fef9-442d-85b7-8cecdf107236 1073741824 Jul 31 10:52:10 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:11 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5515665a-fef9-442d-85b7-8cecdf107236 1073741824" returned: 0 in 0.603s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5515665a-fef9-442d-85b7-8cecdf107236 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:11 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5515665a-fef9-442d-85b7-8cecdf107236 Jul 31 10:52:11 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:11 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5515665a-fef9-442d-85b7-8cecdf107236" returned: 0 in 0.317s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:52:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19038f28-5193-4bf4-abd2-f76267d4f927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5515665a-fef9-442d-85b7-8cecdf107236', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887518b4-2661-4351-bcc7-0d822a0c5b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:11 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Volume volume-5515665a-fef9-442d-85b7-8cecdf107236 (5515665a-fef9-442d-85b7-8cecdf107236): created successfully Jul 31 10:52:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887518b4-2661-4351-bcc7-0d822a0c5b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Flow 'volume_create_manager' (adc35159-fc4e-42e7-ba36-4697326868b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:11 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-07eaed39-107f-4a32-9fc8-d6584ee90a43 tempest-VolumesListAdminTestJSON-125489345 None] Created volume successfully. Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Flow 'volume_create_manager' (2110b688-7783-4fa5-95cb-0b94c9e455b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103bb2ca-4e1d-45dd-a5c0-20d03520cf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103bb2ca-4e1d-45dd-a5c0-20d03520cf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329faea3-6e1f-4413-adc8-123f9b4d9512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9704b08dea4b799c427c9a53b9f442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:14Z,use_quota=True,user_id='79441ce0b37c4a49838373e3d109d27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff7c7c6-0d13-4da6-92cb-a8ea59675977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff7c7c6-0d13-4da6-92cb-a8ea59675977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee8741d-a682-4095-b598-8f2c58a6be6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee8741d-a682-4095-b598-8f2c58a6be6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329faea3-6e1f-4413-adc8-123f9b4d9512', 'volume_name': 'volume-329faea3-6e1f-4413-adc8-123f9b4d9512', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852f597d-270d-4cc2-8052-159ebc2b9f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852f597d-270d-4cc2-8052-159ebc2b9f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45b6be5-bf5c-4e49-8b4a-996d3d0f0403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:13 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Volume 329faea3-6e1f-4413-adc8-123f9b4d9512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329faea3-6e1f-4413-adc8-123f9b4d9512', 'volume_size': 1} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329faea3-6e1f-4413-adc8-123f9b4d9512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9704b08dea4b799c427c9a53b9f442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:14Z,use_quota=True,user_id='79441ce0b37c4a49838373e3d109d27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Creating volume 329faea3-6e1f-4413-adc8-123f9b4d9512 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:52:13 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:52:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-329faea3-6e1f-4413-adc8-123f9b4d9512 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:13 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-329faea3-6e1f-4413-adc8-123f9b4d9512 1073741824 Jul 31 10:52:13 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:14 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-329faea3-6e1f-4413-adc8-123f9b4d9512 1073741824" returned: 0 in 0.550s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-329faea3-6e1f-4413-adc8-123f9b4d9512 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:14 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-329faea3-6e1f-4413-adc8-123f9b4d9512 Jul 31 10:52:14 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:14 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-329faea3-6e1f-4413-adc8-123f9b4d9512" returned: 0 in 0.284s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:52:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45b6be5-bf5c-4e49-8b4a-996d3d0f0403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329faea3-6e1f-4413-adc8-123f9b4d9512', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec02b22d-a5d3-4c84-8327-12fbea159f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:14 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Volume volume-329faea3-6e1f-4413-adc8-123f9b4d9512 (329faea3-6e1f-4413-adc8-123f9b4d9512): created successfully Jul 31 10:52:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec02b22d-a5d3-4c84-8327-12fbea159f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Flow 'volume_create_manager' (2110b688-7783-4fa5-95cb-0b94c9e455b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:14 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7c81405b-6404-475f-a7af-e80e1a862ca1 tempest-VolumesListAdminTestJSON-809788045 None] Created volume successfully. Jul 31 10:52:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Acquiring lock "cinder-329faea3-6e1f-4413-adc8-123f9b4d9512-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Lock "cinder-329faea3-6e1f-4413-adc8-123f9b4d9512-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Acquiring lock "cinder-quobyte-329faea3-6e1f-4413-adc8-123f9b4d9512" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Lock "cinder-quobyte-329faea3-6e1f-4413-adc8-123f9b4d9512" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:16 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e13b97-b3e8-46dd-8086-25b3f387e98d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-329faea3-6e1f-4413-adc8-123f9b4d9512 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "cinder-5515665a-fef9-442d-85b7-8cecdf107236-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:16 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-329faea3-6e1f-4413-adc8-123f9b4d9512 Jul 31 10:52:16 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Lock "cinder-5515665a-fef9-442d-85b7-8cecdf107236-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "cinder-quobyte-5515665a-fef9-442d-85b7-8cecdf107236" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Lock "cinder-quobyte-5515665a-fef9-442d-85b7-8cecdf107236" acquired by "delete_volume" :: waited 0.053s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:16 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfe55a6-b308-4263-b67f-adabd5647b89]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5515665a-fef9-442d-85b7-8cecdf107236 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:16 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-329faea3-6e1f-4413-adc8-123f9b4d9512" returned: 0 in 0.525s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-329faea3-6e1f-4413-adc8-123f9b4d9512 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:16 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5515665a-fef9-442d-85b7-8cecdf107236 Jul 31 10:52:16 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:16 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-329faea3-6e1f-4413-adc8-123f9b4d9512 Jul 31 10:52:16 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:17 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:17 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-329faea3-6e1f-4413-adc8-123f9b4d9512" returned: 0 in 0.382s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5515665a-fef9-442d-85b7-8cecdf107236" returned: 0 in 0.511s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5515665a-fef9-442d-85b7-8cecdf107236 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Lock "cinder-quobyte-329faea3-6e1f-4413-adc8-123f9b4d9512" released by "delete_volume" :: held 1.002s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:17 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5515665a-fef9-442d-85b7-8cecdf107236 Jul 31 10:52:17 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Created reservations ['9f7d7ee6-2e7b-454e-9e78-18909af08593', '6e149e57-d6a0-42f7-9189-fd9f2b408ad8', 'bbc55ab4-e5d7-472f-90eb-77fa4f6b3468', '29ed3e1f-3ead-4383-a0c6-15389237136b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:17 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:52:17 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:17 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5515665a-fef9-442d-85b7-8cecdf107236" returned: 0 in 0.557s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Lock "cinder-quobyte-5515665a-fef9-442d-85b7-8cecdf107236" released by "delete_volume" :: held 1.201s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Created reservations ['40a23ae7-dfc6-4102-8415-64db944185f5', 'bc172796-1837-4390-b892-08cc9776b24c', 'ad35ff24-c503-4d07-a6b9-8f9ceac7cf42', 'bebcf090-b59e-4f37-ba1a-f42a24fb4706'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:52:17 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.441s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:52:17 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Deleted volume successfully. Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4c62315b-9d76-42af-b3c1-8b2785225a06 tempest-VolumesListAdminTestJSON-809788045 None] Lock "cinder-329faea3-6e1f-4413-adc8-123f9b4d9512-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:17 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:52:17 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:18 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.287s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:18 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:52:18 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Deleted volume successfully. Jul 31 10:52:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-686ac433-d1ef-4d12-bb17-b80ddac25409 tempest-VolumesListAdminTestJSON-125489345 None] Lock "cinder-5515665a-fef9-442d-85b7-8cecdf107236-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:18 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-34ead4a9-3050-439d-83f3-e5e52725866b req-8da3a223-47a0-46ab-96ae-25f789aae0f4 tempest-ServerActionsTestOtherA-900741309 None] Terminate volume connection completed successfully. Jul 31 10:52:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-34ead4a9-3050-439d-83f3-e5e52725866b req-8da3a223-47a0-46ab-96ae-25f789aae0f4 tempest-ServerActionsTestOtherA-900741309 None] Deleting attachment 42289d54-4bfa-49a2-b92b-e790c39ae0d2. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:52:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "cinder-90c60469-9233-40a4-af31-dffaf334c5cd-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Lock "cinder-90c60469-9233-40a4-af31-dffaf334c5cd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "cinder-quobyte-90c60469-9233-40a4-af31-dffaf334c5cd" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Lock "cinder-quobyte-90c60469-9233-40a4-af31-dffaf334c5cd" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:18 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[0609cb29-cbc1-40ca-9523-572630ce1e7d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-90c60469-9233-40a4-af31-dffaf334c5cd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:19 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-90c60469-9233-40a4-af31-dffaf334c5cd Jul 31 10:52:19 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:19 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-90c60469-9233-40a4-af31-dffaf334c5cd" returned: 0 in 0.454s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-90c60469-9233-40a4-af31-dffaf334c5cd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:19 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-90c60469-9233-40a4-af31-dffaf334c5cd Jul 31 10:52:19 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:19 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-90c60469-9233-40a4-af31-dffaf334c5cd" returned: 0 in 0.378s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:19 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Lock "cinder-quobyte-90c60469-9233-40a4-af31-dffaf334c5cd" released by "delete_volume" :: held 0.898s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:19 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Created reservations ['6ba30e64-102c-4690-8249-33bf4b84e927', '756115bc-ab4a-45fd-a5a3-f9b83fdc53d8', '854a27a7-b1b9-4fe4-9d7e-f27c365e289b', 'bdc80cd3-9a48-4f6d-90d3-a74c5c950232'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:52:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:19 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:52:19 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "cinder-639f5d3b-dbbd-4afd-b11e-22b713d241c9-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Lock "cinder-639f5d3b-dbbd-4afd-b11e-22b713d241c9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:20 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.391s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:20 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:52:20 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Deleted volume successfully. Jul 31 10:52:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "cinder-quobyte-639f5d3b-dbbd-4afd-b11e-22b713d241c9" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ae818c21-e4bb-45f8-a4ca-99cf0c07b7ad tempest-VolumesListAdminTestJSON-125489345 None] Lock "cinder-90c60469-9233-40a4-af31-dffaf334c5cd-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Lock "cinder-quobyte-639f5d3b-dbbd-4afd-b11e-22b713d241c9" acquired by "delete_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:20 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6442c1-2a5b-4d72-985b-a3c7b936c91a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:20 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9 Jul 31 10:52:20 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:20 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9" returned: 0 in 0.429s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:20 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9 Jul 31 10:52:20 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:21 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-639f5d3b-dbbd-4afd-b11e-22b713d241c9" returned: 0 in 0.305s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Lock "cinder-quobyte-639f5d3b-dbbd-4afd-b11e-22b713d241c9" released by "delete_volume" :: held 0.799s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:21 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Created reservations ['b845e1dc-f487-48f8-a611-e4c6534b7030', '3c2fc841-1844-4032-8e33-2dcd57c172ad', 'cada1859-b5fe-49d9-944c-f6ffc040e4a9', 'f6a1e2d3-b224-4364-b519-167842f90b85'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:52:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:21 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:52:21 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:21 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.351s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:21 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:52:21 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Deleted volume successfully. Jul 31 10:52:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-850cf241-276e-4dac-8af3-354a179b93da tempest-VolumesListAdminTestJSON-125489345 None] Lock "cinder-639f5d3b-dbbd-4afd-b11e-22b713d241c9-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:26 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Acquiring lock "cinder-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:26 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Lock "cinder-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:26 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Acquiring lock "cinder-quobyte-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:26 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Lock "cinder-quobyte-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0" acquired by "delete_volume" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:26 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d9013f-c628-4f04-b116-4785aedb6a48]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:26 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 Jul 31 10:52:26 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:26 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0" returned: 0 in 0.620s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:26 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0 Jul 31 10:52:26 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:27 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0" returned: 0 in 0.346s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Lock "cinder-quobyte-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0" released by "delete_volume" :: held 1.061s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:27 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Created reservations ['7f087ee6-7653-4d93-8d0b-68583c6a17bd', '2676691a-b527-4e79-a0ed-d65859fe04bf', '5417e8fa-6575-4d27-9e05-3618ba7754c1', '83ef29e5-22c7-4838-b6ae-e95d6607ec7d'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:52:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:27 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:52:27 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:28 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.423s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:28 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:52:28 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Deleted volume successfully. Jul 31 10:52:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3aa1ba2a-684e-4f87-b3bc-bd650a246d41 tempest-ServerActionsTestOtherA-900741309 None] Lock "cinder-d7f290bb-f4ad-4f6b-834c-c60ee20d31a0-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:37 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=46,cinder:INSERT=12,cinder:SELECT=33,cinder:DELETE=3 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:52:38 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=35,cinder:UPDATE=58,cinder:DELETE=6,cinder:INSERT=12 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:52:49 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:52:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Flow 'volume_create_manager' (85d4a13a-e1a9-4037-adb7-7b02e45529dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f23605-cd1b-455e-adae-981f22302efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f23605-cd1b-455e-adae-981f22302efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-606833151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a1f426-4e08-4f0f-a857-98656637b70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949db58f513e4cd1ba4bdf8949cca571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:50Z,use_quota=True,user_id='ac90ae19b1db4d8b9e9742d4fed7a844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cfaa16-404d-4469-8962-10115bdec2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cfaa16-404d-4469-8962-10115bdec2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd86cd29-3e94-4023-b4e1-ebe7315eac05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd86cd29-3e94-4023-b4e1-ebe7315eac05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a1f426-4e08-4f0f-a857-98656637b70c', 'volume_name': 'volume-b9a1f426-4e08-4f0f-a857-98656637b70c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb816ed-7464-48b3-a4a8-683d8e8110b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb816ed-7464-48b3-a4a8-683d8e8110b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0eed2d8-c785-495c-a436-d97ebf256cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:50 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Volume b9a1f426-4e08-4f0f-a857-98656637b70c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a1f426-4e08-4f0f-a857-98656637b70c', 'volume_size': 1} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-606833151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a1f426-4e08-4f0f-a857-98656637b70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949db58f513e4cd1ba4bdf8949cca571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:50Z,use_quota=True,user_id='ac90ae19b1db4d8b9e9742d4fed7a844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Creating volume b9a1f426-4e08-4f0f-a857-98656637b70c {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:52:50 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:50 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c 1073741824 Jul 31 10:52:50 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Flow 'volume_create_manager' (847bd26d-f401-4efc-843b-7db82b6093b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49640dc7-6fcd-4044-92d5-f47c5293bf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49640dc7-6fcd-4044-92d5-f47c5293bf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1715592992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed64912-05c1-451a-9418-0a4e65639e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117e5df7550f47dc886731370293cf60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:50Z,use_quota=True,user_id='90f8da9504a4435bb111fe066a6204a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3d417a-04d7-4a02-8d57-06fb5bc1308a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3d417a-04d7-4a02-8d57-06fb5bc1308a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e633b8d-47eb-4f7d-b782-fd923d2a16f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e633b8d-47eb-4f7d-b782-fd923d2a16f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed64912-05c1-451a-9418-0a4e65639e2d', 'volume_name': 'volume-eed64912-05c1-451a-9418-0a4e65639e2d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f083d67a-24d1-41fa-8613-60f638a36bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f083d67a-24d1-41fa-8613-60f638a36bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8e9548-c968-4168-abe1-4fc874e20e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:50 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Volume eed64912-05c1-451a-9418-0a4e65639e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed64912-05c1-451a-9418-0a4e65639e2d', 'volume_size': 1} Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:50 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c 1073741824" returned: 0 in 0.937s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:51 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c Jul 31 10:52:51 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:51 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c" returned: 0 in 0.361s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1715592992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed64912-05c1-451a-9418-0a4e65639e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117e5df7550f47dc886731370293cf60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:50Z,use_quota=True,user_id='90f8da9504a4435bb111fe066a6204a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Creating volume eed64912-05c1-451a-9418-0a4e65639e2d {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:52:51 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0eed2d8-c785-495c-a436-d97ebf256cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a1f426-4e08-4f0f-a857-98656637b70c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520a592c-cea5-4813-a89c-c39b25244918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:51 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d 1073741824 Jul 31 10:52:51 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:51 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Volume volume-b9a1f426-4e08-4f0f-a857-98656637b70c (b9a1f426-4e08-4f0f-a857-98656637b70c): created successfully Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520a592c-cea5-4813-a89c-c39b25244918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Flow 'volume_create_manager' (85d4a13a-e1a9-4037-adb7-7b02e45529dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:51 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f1dadee3-9394-40e3-8c60-84dee3edde97 tempest-TaggedAttachmentsTest-843301888 None] Created volume successfully. Jul 31 10:52:52 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d 1073741824" returned: 0 in 0.650s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:52 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d Jul 31 10:52:52 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:52 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d" returned: 0 in 0.339s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:52:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8e9548-c968-4168-abe1-4fc874e20e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed64912-05c1-451a-9418-0a4e65639e2d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94df3cf-60ee-47fc-a84d-c86b9e73778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:52 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Volume volume-eed64912-05c1-451a-9418-0a4e65639e2d (eed64912-05c1-451a-9418-0a4e65639e2d): created successfully Jul 31 10:52:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94df3cf-60ee-47fc-a84d-c86b9e73778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Flow 'volume_create_manager' (847bd26d-f401-4efc-843b-7db82b6093b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-21eafb2e-d1dc-47c5-a501-285f97e546ee tempest-VolumesActionsTest-1827843870 None] Created volume successfully. Jul 31 10:53:02 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:53:02 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=3,cinder:UPDATE=7,cinder:DELETE=2,cinder:INSERT=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:53:03 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Flow 'volume_create_manager' (af364e71-fbbd-4107-b57c-dfbcbe03d763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39719959-011a-47e9-ad13-171c4f51a089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39719959-011a-47e9-ad13-171c4f51a089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1032514306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53579c1f-d88a-4e90-a7be-f6597f7ca2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4712355490f4f00bb2d4efb6e8539e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:04Z,use_quota=True,user_id='7e8a5d6951f64559a52ae4f46330b63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b29972-8e84-4608-b587-30014639d451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b29972-8e84-4608-b587-30014639d451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddf90ff-bd20-4d81-9ff2-c5cf5720a661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddf90ff-bd20-4d81-9ff2-c5cf5720a661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53579c1f-d88a-4e90-a7be-f6597f7ca2b6', 'volume_name': 'volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a183fa-8c91-4b12-acfa-63089d71aedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a183fa-8c91-4b12-acfa-63089d71aedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6379ab-54a2-44e6-a75d-c87630162c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:04 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Volume 53579c1f-d88a-4e90-a7be-f6597f7ca2b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6', 'volume_size': 1} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1032514306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53579c1f-d88a-4e90-a7be-f6597f7ca2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4712355490f4f00bb2d4efb6e8539e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:04Z,use_quota=True,user_id='7e8a5d6951f64559a52ae4f46330b63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Creating volume 53579c1f-d88a-4e90-a7be-f6597f7ca2b6 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:53:04 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:53:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:04 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6 1073741824 Jul 31 10:53:04 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:05 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6 1073741824" returned: 0 in 0.971s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:05 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6 Jul 31 10:53:05 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:05 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6" returned: 0 in 0.606s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6379ab-54a2-44e6-a75d-c87630162c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b0b6df-4672-4aaa-aeb2-081d36866444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Volume volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6 (53579c1f-d88a-4e90-a7be-f6597f7ca2b6): created successfully Jul 31 10:53:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b0b6df-4672-4aaa-aeb2-081d36866444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Flow 'volume_create_manager' (af364e71-fbbd-4107-b57c-dfbcbe03d763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:05 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8e0c0247-b380-4b30-8c75-fbb71aa052f2 tempest-AttachVolumeNegativeTest-1174809077 None] Created volume successfully. Jul 31 10:53:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:53:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:53:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:53:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:08 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:53:08 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:08 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.547s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:53:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-28bb8660-ecaf-4327-b72f-6b0a11ba8f0e req-bf48b9fb-755f-4530-85c2-d8c7a07e01e8 tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-28bb8660-ecaf-4327-b72f-6b0a11ba8f0e req-bf48b9fb-755f-4530-85c2-d8c7a07e01e8 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:09 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91b4421-c158-457a-9885-3bc00011bae9]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-28bb8660-ecaf-4327-b72f-6b0a11ba8f0e req-bf48b9fb-755f-4530-85c2-d8c7a07e01e8 tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:10 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6 Jul 31 10:53:10 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a8818565-ebc9-4e4c-b0e4-dc07f042db51 tempest-VolumesActionsTest-1827843870 None] Acquiring lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d" by "attach_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a8818565-ebc9-4e4c-b0e4-dc07f042db51 tempest-VolumesActionsTest-1827843870 None] Lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d" acquired by "attach_volume" :: waited 0.083s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a8818565-ebc9-4e4c-b0e4-dc07f042db51 tempest-VolumesActionsTest-1827843870 None] Attaching volume eed64912-05c1-451a-9418-0a4e65639e2d to instance c37edcfc-6e16-49b1-9482-407335ab0cf3 at mountpoint /dev/vdb on host None. Jul 31 10:53:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a8818565-ebc9-4e4c-b0e4-dc07f042db51 tempest-VolumesActionsTest-1827843870 None] Attach volume completed successfully. Jul 31 10:53:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a8818565-ebc9-4e4c-b0e4-dc07f042db51 tempest-VolumesActionsTest-1827843870 None] Lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d" released by "attach_volume" :: held 0.295s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:10 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-28bb8660-ecaf-4327-b72f-6b0a11ba8f0e req-bf48b9fb-755f-4530-85c2-d8c7a07e01e8 tempest-AttachVolumeNegativeTest-1174809077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6" returned: 0 in 0.908s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-28bb8660-ecaf-4327-b72f-6b0a11ba8f0e req-bf48b9fb-755f-4530-85c2-d8c7a07e01e8 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-28bb8660-ecaf-4327-b72f-6b0a11ba8f0e req-bf48b9fb-755f-4530-85c2-d8c7a07e01e8 tempest-AttachVolumeNegativeTest-1174809077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30d00e7d-5f65-4eea-96f7-1deaa745aa0a', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:53:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e6bc1fc-89ef-4a20-a111-0648706c24f2 tempest-VolumesActionsTest-1827843870 None] Acquiring lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d-detach_volume" by "detach_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:11 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-28bb8660-ecaf-4327-b72f-6b0a11ba8f0e req-bf48b9fb-755f-4530-85c2-d8c7a07e01e8 tempest-AttachVolumeNegativeTest-1174809077 None] attachment_update completed successfully. Jul 31 10:53:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e6bc1fc-89ef-4a20-a111-0648706c24f2 tempest-VolumesActionsTest-1827843870 None] Lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d-detach_volume" acquired by "detach_volume" :: waited 0.059s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:11 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3e6bc1fc-89ef-4a20-a111-0648706c24f2 tempest-VolumesActionsTest-1827843870 None] Detaching volume eed64912-05c1-451a-9418-0a4e65639e2d from instance c37edcfc-6e16-49b1-9482-407335ab0cf3. Jul 31 10:53:11 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3e6bc1fc-89ef-4a20-a111-0648706c24f2 tempest-VolumesActionsTest-1827843870 None] Detach volume completed successfully. Jul 31 10:53:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e6bc1fc-89ef-4a20-a111-0648706c24f2 tempest-VolumesActionsTest-1827843870 None] Lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d-detach_volume" released by "detach_volume" :: held 0.211s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:21 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:53:21 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=9,cinder:SELECT=16,cinder:DELETE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:53:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b3bfbfec-d480-41b7-8b6f-896634796a5c tempest-VolumesActionsTest-1827843870 None] Acquiring lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d" by "attach_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b3bfbfec-d480-41b7-8b6f-896634796a5c tempest-VolumesActionsTest-1827843870 None] Lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d" acquired by "attach_volume" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b3bfbfec-d480-41b7-8b6f-896634796a5c tempest-VolumesActionsTest-1827843870 None] Attaching volume eed64912-05c1-451a-9418-0a4e65639e2d to instance 5f7c0d52-4bc5-49f5-b248-cef52a0888b6 at mountpoint /dev/vdb on host None. Jul 31 10:53:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b3bfbfec-d480-41b7-8b6f-896634796a5c tempest-VolumesActionsTest-1827843870 None] Attach volume completed successfully. Jul 31 10:53:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b3bfbfec-d480-41b7-8b6f-896634796a5c tempest-VolumesActionsTest-1827843870 None] Lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d" released by "attach_volume" :: held 0.195s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7cf215b2-8481-4a4d-9a83-152e503a2f93 tempest-VolumesActionsTest-1827843870 None] Acquiring lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d-detach_volume" by "detach_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7cf215b2-8481-4a4d-9a83-152e503a2f93 tempest-VolumesActionsTest-1827843870 None] Lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7cf215b2-8481-4a4d-9a83-152e503a2f93 tempest-VolumesActionsTest-1827843870 None] Detaching volume eed64912-05c1-451a-9418-0a4e65639e2d from instance 5f7c0d52-4bc5-49f5-b248-cef52a0888b6. Jul 31 10:53:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7cf215b2-8481-4a4d-9a83-152e503a2f93 tempest-VolumesActionsTest-1827843870 None] Detach volume completed successfully. Jul 31 10:53:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7cf215b2-8481-4a4d-9a83-152e503a2f93 tempest-VolumesActionsTest-1827843870 None] Lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Flow 'volume_create_manager' (68bde9cc-a1e3-40c1-8b6c-ace001514a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad059961-9f54-43f3-9bd7-7806f30ee0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad059961-9f54-43f3-9bd7-7806f30ee0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1945658116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8c7515-de50-4c33-a2d3-9c7ed6f442f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc1c418074a4bb29232f7d9b74007fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:48Z,use_quota=True,user_id='e83d36d250fa49b68cdb84083c3928b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd2db4c-3de7-4bc2-8698-b030d88d2e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd2db4c-3de7-4bc2-8698-b030d88d2e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e348141-9ec9-4d9c-81d9-03249ccf3ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e348141-9ec9-4d9c-81d9-03249ccf3ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c8c7515-de50-4c33-a2d3-9c7ed6f442f5', 'volume_name': 'volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14be499-ed97-41f5-84e0-6295284e8d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14be499-ed97-41f5-84e0-6295284e8d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecb1d64-10e8-4378-beb2-98808b5799c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:48 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Volume 8c8c7515-de50-4c33-a2d3-9c7ed6f442f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5', 'volume_size': 1} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1945658116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8c7515-de50-4c33-a2d3-9c7ed6f442f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc1c418074a4bb29232f7d9b74007fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:48Z,use_quota=True,user_id='e83d36d250fa49b68cdb84083c3928b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Creating volume 8c8c7515-de50-4c33-a2d3-9c7ed6f442f5 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:53:48 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:53:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:48 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5 1073741824 Jul 31 10:53:48 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:50 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5 1073741824" returned: 0 in 1.453s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:50 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5 Jul 31 10:53:50 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:51 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5" returned: 0 in 0.724s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] <== create_volume: return (2436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.448s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecb1d64-10e8-4378-beb2-98808b5799c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b4b3fd-7a66-4051-8fb5-c6f9a883d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:51 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Volume volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5 (8c8c7515-de50-4c33-a2d3-9c7ed6f442f5): created successfully Jul 31 10:53:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b4b3fd-7a66-4051-8fb5-c6f9a883d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Flow 'volume_create_manager' (68bde9cc-a1e3-40c1-8b6c-ace001514a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:51 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-982c709a-fef8-4713-9dd4-7c2b9f80c119 tempest-ServerRescueNegativeTestJSON-1253868055 None] Created volume successfully. Jul 31 10:53:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-b163e3d1-03d1-4a8c-94bd-223ba6d1c9b6 req-da9c2cf4-19d7-49fc-a931-36061a994e1a tempest-TaggedAttachmentsTest-843301888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-b163e3d1-03d1-4a8c-94bd-223ba6d1c9b6 req-da9c2cf4-19d7-49fc-a931-36061a994e1a tempest-TaggedAttachmentsTest-843301888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:51 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a83938-851a-474a-b4ee-4b0ebb506361]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b163e3d1-03d1-4a8c-94bd-223ba6d1c9b6 req-da9c2cf4-19d7-49fc-a931-36061a994e1a tempest-TaggedAttachmentsTest-843301888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:51 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c Jul 31 10:53:51 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:52 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b163e3d1-03d1-4a8c-94bd-223ba6d1c9b6 req-da9c2cf4-19d7-49fc-a931-36061a994e1a tempest-TaggedAttachmentsTest-843301888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c" returned: 0 in 0.755s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-b163e3d1-03d1-4a8c-94bd-223ba6d1c9b6 req-da9c2cf4-19d7-49fc-a931-36061a994e1a tempest-TaggedAttachmentsTest-843301888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.787s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.360s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:52 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffb92f8-ba63-4679-a730-b59b15af1e41]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-b163e3d1-03d1-4a8c-94bd-223ba6d1c9b6 req-da9c2cf4-19d7-49fc-a931-36061a994e1a tempest-TaggedAttachmentsTest-843301888 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-b9a1f426-4e08-4f0f-a857-98656637b70c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f91d4928-12e9-4a09-87a4-d0336d318343', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:53:52 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d Jul 31 10:53:52 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-b163e3d1-03d1-4a8c-94bd-223ba6d1c9b6 req-da9c2cf4-19d7-49fc-a931-36061a994e1a tempest-TaggedAttachmentsTest-843301888 None] attachment_update completed successfully. Jul 31 10:53:53 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d" returned: 0 in 0.838s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:53 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ddae37-eed6-42eb-8b7c-4cbc7d3ecd36]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:53 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d Jul 31 10:53:53 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:54 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d" returned: 0 in 0.767s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.5bdab24a-2d05-4ec3-b2fa-24ec1f1411abwjp3h2c7.img {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:54 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.5bdab24a-2d05-4ec3-b2fa-24ec1f1411abwjp3h2c7.img Jul 31 10:53:54 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:01 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-4b0abad7-14f5-4e51-8be9-ddcb625892a2 req-17218a90-4d1b-4352-851c-e228debd4c1b tempest-TaggedAttachmentsTest-843301888 None] Terminate volume connection completed successfully. Jul 31 10:54:01 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-4b0abad7-14f5-4e51-8be9-ddcb625892a2 req-17218a90-4d1b-4352-851c-e228debd4c1b tempest-TaggedAttachmentsTest-843301888 None] Deleting attachment f91d4928-12e9-4a09-87a4-d0336d318343. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:54:02 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:54:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.5bdab24a-2d05-4ec3-b2fa-24ec1f1411abwjp3h2c7.img" returned: 0 in 9.406s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:03 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e41a3b-ff66-49aa-9d65-a7e550f5997e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:03 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d Jul 31 10:54:03 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:04 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d" returned: 0 in 0.750s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:04 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d, size 1024.00 MB, duration 9.41 sec, destination /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.5bdab24a-2d05-4ec3-b2fa-24ec1f1411abwjp3h2c7.img {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:54:04 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] Converted 1024.00 MB image at 108.83 MB/s Jul 31 10:54:04 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] 5bdab24a-2d05-4ec3-b2fa-24ec1f1411ab was raw, no need to convert to raw {{(pid=89145) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 31 10:54:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:54:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:08 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:54:08 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:09 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.796s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:09 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:09 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:54:09 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:54:09 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:54:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Acquiring lock "cinder-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Lock "cinder-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Acquiring lock "cinder-quobyte-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Lock "cinder-quobyte-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5" acquired by "delete_volume" :: waited 0.045s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:10 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0dbbc0-3755-45b6-973a-bdbcedd015f0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:11 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5 Jul 31 10:54:11 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:11 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5" returned: 0 in 0.827s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:11 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5 Jul 31 10:54:11 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:12 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5" returned: 0 in 0.469s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Lock "cinder-quobyte-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5" released by "delete_volume" :: held 1.431s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:12 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Created reservations ['234d2916-9634-41aa-8399-1ca9a52fce83', '0192a07a-fba0-413c-a134-724a86db77de', 'fa5cc629-ad49-43c2-a2e5-2edfcffd7a4d', 'e338ec93-2891-4d30-942d-f317696e22c9'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:12 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:54:12 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:13 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.591s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:13 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:13 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Deleted volume successfully. Jul 31 10:54:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-026e604c-67f1-48d8-aec0-6a5db0320f52 tempest-ServerRescueNegativeTestJSON-1253868055 None] Lock "cinder-8c8c7515-de50-4c33-a2d3-9c7ed6f442f5-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Acquiring lock "cinder-b9a1f426-4e08-4f0f-a857-98656637b70c-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Lock "cinder-b9a1f426-4e08-4f0f-a857-98656637b70c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Acquiring lock "cinder-quobyte-b9a1f426-4e08-4f0f-a857-98656637b70c" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Lock "cinder-quobyte-b9a1f426-4e08-4f0f-a857-98656637b70c" acquired by "delete_volume" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:17 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0b73dc-a670-4e26-a662-4f8d68e345cb]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:17 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c Jul 31 10:54:17 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:17 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c" returned: 0 in 0.613s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:17 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c Jul 31 10:54:17 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:18 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b9a1f426-4e08-4f0f-a857-98656637b70c" returned: 0 in 0.266s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Lock "cinder-quobyte-b9a1f426-4e08-4f0f-a857-98656637b70c" released by "delete_volume" :: held 0.942s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:18 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Created reservations ['e8d96b87-e0e3-42cd-8ef1-8c27bb53c36f', 'aa9880e2-d15e-40d9-99b2-5c7bc9cb92d6', '05ee8eaf-110e-49a6-a515-1ce5449c73ed', '8624c5b3-b5a4-49ed-9415-ff91a37c51ae'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:18 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:18 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:18 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:54:18 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:18 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.444s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:18 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:18 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Deleted volume successfully. Jul 31 10:54:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ff839a00-dbc8-478d-a5b6-49ed402e3cf7 tempest-TaggedAttachmentsTest-843301888 None] Lock "cinder-b9a1f426-4e08-4f0f-a857-98656637b70c-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:28 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=10,cinder:UPDATE=18,cinder:INSERT=7 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:54:28 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:INSERT=4,cinder:SELECT=29,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:54:30 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-2d02385a-1061-4ae4-82cd-54a0b89c1783 req-3c66f2a6-cfe6-4f92-8d04-e6283d586cea tempest-AttachVolumeNegativeTest-1174809077 None] Terminate volume connection completed successfully. Jul 31 10:54:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-2d02385a-1061-4ae4-82cd-54a0b89c1783 req-3c66f2a6-cfe6-4f92-8d04-e6283d586cea tempest-AttachVolumeNegativeTest-1174809077 None] Deleting attachment 30d00e7d-5f65-4eea-96f7-1deaa745aa0a. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:54:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 44.322s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] Uploaded volume to glance image-id: 5bdab24a-2d05-4ec3-b2fa-24ec1f1411ab. {{(pid=89145) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 10:54:36 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-0b019b17-56ce-4913-bb1a-d0b4cb97f664 tempest-VolumesActionsTest-1827843870 None] Copy volume to image completed successfully. Jul 31 10:54:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:38 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a2841a-4998-4c31-990f-52ddd311a096]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:38 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d Jul 31 10:54:38 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:38 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d" returned: 0 in 0.416s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:38 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab55c9f-f0f2-4ce1-b89f-a6bcfcb11a73]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:38 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d Jul 31 10:54:38 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:39 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d" returned: 0 in 0.454s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:39 devstack sudo[94738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img Jul 31 10:54:39 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:44 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img" returned: 0 in 5.169s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:44 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[6569de03-6deb-48cb-9d40-4d9df4a17872]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:44 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d Jul 31 10:54:44 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:45 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d" returned: 0 in 0.584s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:45 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d, size 1024.00 MB, duration 5.17 sec, destination /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:54:45 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Converted 1024.00 MB image at 198.05 MB/s Jul 31 10:54:45 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] 0481b9f7-bad7-48fa-932b-8a0a3e05cb95 was raw, converting to qcow2 {{(pid=89145) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 31 10:54:45 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba03b21-b4d7-4395-8418-d393450d0b5d]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:45 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img Jul 31 10:54:45 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:45 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img" returned: 0 in 0.504s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:45 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img Jul 31 10:54:45 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:46 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img" returned: 1 in 0.416s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:54:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img /opt/stack/data/cinder/conversion/vol_upload_35zjkrs0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:46 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img /opt/stack/data/cinder/conversion/vol_upload_35zjkrs0 Jul 31 10:54:46 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:46 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img /opt/stack/data/cinder/conversion/vol_upload_35zjkrs0" returned: 0 in 0.421s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:46 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Image conversion details: src /opt/stack/data/cinder/conversion/eed64912-05c1-451a-9418-0a4e65639e2d.temp_image.0481b9f7-bad7-48fa-932b-8a0a3e05cb9568cundw9.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_35zjkrs0 {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:54:46 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 10:54:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2b52f4-49b3-4402-8904-7b38617d5b45]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_35zjkrs0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:46 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_35zjkrs0 Jul 31 10:54:46 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:46 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_35zjkrs0" returned: 0 in 0.495s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.351s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Uploaded volume to glance image-id: 0481b9f7-bad7-48fa-932b-8a0a3e05cb95. {{(pid=89145) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 10:54:48 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-97ce2dbd-cd9f-47f6-979d-a0e916efe683 tempest-VolumesActionsTest-1827843870 None] Copy volume to image completed successfully. Jul 31 10:54:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Acquiring lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Acquiring lock "cinder-quobyte-eed64912-05c1-451a-9418-0a4e65639e2d" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Lock "cinder-quobyte-eed64912-05c1-451a-9418-0a4e65639e2d" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:50 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab420c9-7d5c-4615-85a4-dd65c93dbbc8]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:50 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d Jul 31 10:54:50 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:50 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d" returned: 0 in 0.540s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:50 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d Jul 31 10:54:50 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:51 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eed64912-05c1-451a-9418-0a4e65639e2d" returned: 0 in 0.547s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Lock "cinder-quobyte-eed64912-05c1-451a-9418-0a4e65639e2d" released by "delete_volume" :: held 1.147s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:51 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Created reservations ['4a548a07-1005-4b28-a0f2-6cca27f97e9b', 'c4a64b65-2cc4-4431-a9db-d576d5a82849', '0e75a130-e00c-4fb0-88d7-8448784b671c', 'c85aeb60-df3a-42bc-9787-5eaeb2ee8b2f'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:51 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:54:51 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:51 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.472s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:51 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Deleted volume successfully. Jul 31 10:54:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7960a275-e688-4cfc-81b3-e55d1f63519b tempest-VolumesActionsTest-1827843870 None] Lock "cinder-eed64912-05c1-451a-9418-0a4e65639e2d-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:01 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:55:02 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:55:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:55:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:08 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:55:08 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:08 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.618s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:55:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:55:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Flow 'volume_create_manager' (9c30217b-1cd9-4c2e-8e22-98f170b90d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157c99f9-18b2-4443-95b5-e5e0cf0095e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157c99f9-18b2-4443-95b5-e5e0cf0095e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1474682304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6aaabe4-ff6e-456c-a049-e052ed1709a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58ce0bf9c2f49a89e6b4c614a94bd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:11Z,use_quota=True,user_id='81946f908335442694dbb118001b6000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e09c87d-a906-41fd-b366-3de611b6350e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e09c87d-a906-41fd-b366-3de611b6350e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f82160-3e93-4f0a-bf67-27411612aef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f82160-3e93-4f0a-bf67-27411612aef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6aaabe4-ff6e-456c-a049-e052ed1709a0', 'volume_name': 'volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763e0e61-5d87-4119-951a-11b72049f20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763e0e61-5d87-4119-951a-11b72049f20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2c684d-b348-40fa-927e-f1cf9319d177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:11 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Volume b6aaabe4-ff6e-456c-a049-e052ed1709a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0', 'volume_size': 1} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1474682304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6aaabe4-ff6e-456c-a049-e052ed1709a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58ce0bf9c2f49a89e6b4c614a94bd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:11Z,use_quota=True,user_id='81946f908335442694dbb118001b6000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Creating volume b6aaabe4-ff6e-456c-a049-e052ed1709a0 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:55:11 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:55:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:12 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0 1073741824 Jul 31 10:55:12 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:13 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0 1073741824" returned: 0 in 1.737s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:13 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0 Jul 31 10:55:13 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:14 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0" returned: 0 in 0.957s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] <== create_volume: return (2835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.841s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2c684d-b348-40fa-927e-f1cf9319d177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae367ea2-d62b-4df3-b5bb-c77bc2b2e44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:14 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Volume volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0 (b6aaabe4-ff6e-456c-a049-e052ed1709a0): created successfully Jul 31 10:55:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae367ea2-d62b-4df3-b5bb-c77bc2b2e44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Flow 'volume_create_manager' (9c30217b-1cd9-4c2e-8e22-98f170b90d15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:14 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-61ed876c-f197-4cf8-9478-8cb1d2ac0f13 tempest-VolumesNegativeTest-1013669154 None] Created volume successfully. Jul 31 10:55:24 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:55:24 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1,cinder:DELETE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Flow 'volume_create_manager' (e9d99563-28ab-4cb5-84c8-14a68d01ab99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f24627-d587-4afe-82ab-5b158db3bbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f24627-d587-4afe-82ab-5b158db3bbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-205935214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f033188-9ade-4e32-82d4-a0b7d00e6271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4712355490f4f00bb2d4efb6e8539e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:34Z,use_quota=True,user_id='7e8a5d6951f64559a52ae4f46330b63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef53e36d-4878-421e-bc52-e74a5eca8342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef53e36d-4878-421e-bc52-e74a5eca8342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6812beb9-741e-4dfa-ba7b-8243a5cb11aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6812beb9-741e-4dfa-ba7b-8243a5cb11aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f033188-9ade-4e32-82d4-a0b7d00e6271', 'volume_name': 'volume-5f033188-9ade-4e32-82d4-a0b7d00e6271', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7364c4f5-a196-457e-a138-a9a49904813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7364c4f5-a196-457e-a138-a9a49904813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fa3322-fe7d-4e87-98c9-53d6748eacec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:34 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Volume 5f033188-9ade-4e32-82d4-a0b7d00e6271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f033188-9ade-4e32-82d4-a0b7d00e6271', 'volume_size': 1} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-205935214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f033188-9ade-4e32-82d4-a0b7d00e6271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4712355490f4f00bb2d4efb6e8539e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:34Z,use_quota=True,user_id='7e8a5d6951f64559a52ae4f46330b63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Creating volume 5f033188-9ade-4e32-82d4-a0b7d00e6271 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:55:34 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:55:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:34 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271 1073741824 Jul 31 10:55:34 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:35 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Flow 'volume_create_manager' (857b5fe5-b4c3-40c3-ae50-592285888ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39281c09-7c34-45b0-bb4f-16b5d6a2bfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271 1073741824" returned: 0 in 0.675s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39281c09-7c34-45b0-bb4f-16b5d6a2bfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-324602971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc95a8b7-ec53-4736-804f-6613476a8de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c929f307874162905f55e942bae89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:35Z,use_quota=True,user_id='13d1d171a3a043bd9977c890ae7a2d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad58a247-4d73-43d7-8406-c7475bcc90b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad58a247-4d73-43d7-8406-c7475bcc90b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a08799-d4aa-4877-a9de-0f2002887acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a08799-d4aa-4877-a9de-0f2002887acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc95a8b7-ec53-4736-804f-6613476a8de9', 'volume_name': 'volume-cc95a8b7-ec53-4736-804f-6613476a8de9', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1473e3-804c-466f-977a-38857a8c0d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1473e3-804c-466f-977a-38857a8c0d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d9672a-f395-4c41-89d4-445cde6900a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:35 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Volume cc95a8b7-ec53-4736-804f-6613476a8de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc95a8b7-ec53-4736-804f-6613476a8de9', 'volume_size': 1} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:35 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271 Jul 31 10:55:35 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:35 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271" returned: 0 in 0.267s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.292s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-324602971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc95a8b7-ec53-4736-804f-6613476a8de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c929f307874162905f55e942bae89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:35Z,use_quota=True,user_id='13d1d171a3a043bd9977c890ae7a2d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Creating volume cc95a8b7-ec53-4736-804f-6613476a8de9 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:55:35 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc95a8b7-ec53-4736-804f-6613476a8de9 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fa3322-fe7d-4e87-98c9-53d6748eacec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f033188-9ade-4e32-82d4-a0b7d00e6271', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e020195c-1b74-4ac3-98c5-27eaa06236a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:35 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc95a8b7-ec53-4736-804f-6613476a8de9 1073741824 Jul 31 10:55:35 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:35 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Volume volume-5f033188-9ade-4e32-82d4-a0b7d00e6271 (5f033188-9ade-4e32-82d4-a0b7d00e6271): created successfully Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e020195c-1b74-4ac3-98c5-27eaa06236a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Flow 'volume_create_manager' (e9d99563-28ab-4cb5-84c8-14a68d01ab99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:35 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-13933cec-737e-40fc-8d94-944ff0c75dc7 tempest-AttachVolumeNegativeTest-1174809077 None] Created volume successfully. Jul 31 10:55:36 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc95a8b7-ec53-4736-804f-6613476a8de9 1073741824" returned: 0 in 0.677s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc95a8b7-ec53-4736-804f-6613476a8de9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:36 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc95a8b7-ec53-4736-804f-6613476a8de9 Jul 31 10:55:36 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:36 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc95a8b7-ec53-4736-804f-6613476a8de9" returned: 0 in 0.405s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d9672a-f395-4c41-89d4-445cde6900a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc95a8b7-ec53-4736-804f-6613476a8de9', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccba3fab-0196-4eab-8c99-1bbfa827f9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:36 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Volume volume-cc95a8b7-ec53-4736-804f-6613476a8de9 (cc95a8b7-ec53-4736-804f-6613476a8de9): created successfully Jul 31 10:55:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccba3fab-0196-4eab-8c99-1bbfa827f9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Flow 'volume_create_manager' (857b5fe5-b4c3-40c3-ae50-592285888ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:36 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d28ec7d0-c152-4e69-9c9a-b1d8397f3c6f tempest-ServersNegativeTestJSON-711113202 None] Created volume successfully. Jul 31 10:55:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-55255995-3526-4c02-bd55-8b9f8f6e5da1 req-c7a7cbf1-31ae-4f1e-8245-6c5e1330e30d tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-55255995-3526-4c02-bd55-8b9f8f6e5da1 req-c7a7cbf1-31ae-4f1e-8245-6c5e1330e30d tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab83e021-7cde-4a3b-a876-733166d15c4f]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-55255995-3526-4c02-bd55-8b9f8f6e5da1 req-c7a7cbf1-31ae-4f1e-8245-6c5e1330e30d tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:37 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271 Jul 31 10:55:37 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:37 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-55255995-3526-4c02-bd55-8b9f8f6e5da1 req-c7a7cbf1-31ae-4f1e-8245-6c5e1330e30d tempest-AttachVolumeNegativeTest-1174809077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271" returned: 0 in 0.412s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-55255995-3526-4c02-bd55-8b9f8f6e5da1 req-c7a7cbf1-31ae-4f1e-8245-6c5e1330e30d tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.429s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-55255995-3526-4c02-bd55-8b9f8f6e5da1 req-c7a7cbf1-31ae-4f1e-8245-6c5e1330e30d tempest-AttachVolumeNegativeTest-1174809077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-5f033188-9ade-4e32-82d4-a0b7d00e6271', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9edd169-065f-445a-b0be-260709da7064', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:55:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-55255995-3526-4c02-bd55-8b9f8f6e5da1 req-c7a7cbf1-31ae-4f1e-8245-6c5e1330e30d tempest-AttachVolumeNegativeTest-1174809077 None] attachment_update completed successfully. Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Flow 'volume_create_manager' (381026a7-b558-4f65-84a7-09185506b4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546d7252-6a09-4b03-a7e1-32fdb44131d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546d7252-6a09-4b03-a7e1-32fdb44131d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-22147022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef7392c-230e-46c5-bbda-f3d85d21ea0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c929f307874162905f55e942bae89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:39Z,use_quota=True,user_id='13d1d171a3a043bd9977c890ae7a2d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068c22f8-d631-4e12-98f4-39d507cec174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068c22f8-d631-4e12-98f4-39d507cec174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367383f6-bc9b-4546-a46c-3d19706334f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367383f6-bc9b-4546-a46c-3d19706334f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef7392c-230e-46c5-bbda-f3d85d21ea0f', 'volume_name': 'volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e936c908-0296-4ed7-89d4-6828161ab172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e936c908-0296-4ed7-89d4-6828161ab172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8016fb83-e4e3-4224-8a2d-e7496894517a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:38 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Volume bef7392c-230e-46c5-bbda-f3d85d21ea0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f', 'volume_size': 1} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-22147022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef7392c-230e-46c5-bbda-f3d85d21ea0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c929f307874162905f55e942bae89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:39Z,use_quota=True,user_id='13d1d171a3a043bd9977c890ae7a2d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Creating volume bef7392c-230e-46c5-bbda-f3d85d21ea0f {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:55:38 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:55:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:38 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f 1073741824 Jul 31 10:55:38 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:39 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f 1073741824" returned: 0 in 0.505s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:39 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f Jul 31 10:55:39 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:39 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f" returned: 0 in 0.286s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8016fb83-e4e3-4224-8a2d-e7496894517a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024b005b-f973-421e-8230-d775353ad764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:39 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Volume volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f (bef7392c-230e-46c5-bbda-f3d85d21ea0f): created successfully Jul 31 10:55:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024b005b-f973-421e-8230-d775353ad764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Flow 'volume_create_manager' (381026a7-b558-4f65-84a7-09185506b4c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1f9ef7d8-92df-4411-afc9-e06b84fa5c0d tempest-ServersNegativeTestJSON-711113202 None] Created volume successfully. Jul 31 10:55:40 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-07871153-12a5-459a-baa2-ded57d211324 req-6c6922fe-99d0-4059-86c9-e8627f4af44f tempest-AttachVolumeNegativeTest-1174809077 None] Terminate volume connection completed successfully. Jul 31 10:55:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-07871153-12a5-459a-baa2-ded57d211324 req-6c6922fe-99d0-4059-86c9-e8627f4af44f tempest-AttachVolumeNegativeTest-1174809077 None] Deleting attachment a9edd169-065f-445a-b0be-260709da7064. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:55:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Acquiring lock "cinder-bef7392c-230e-46c5-bbda-f3d85d21ea0f-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Lock "cinder-bef7392c-230e-46c5-bbda-f3d85d21ea0f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Acquiring lock "cinder-quobyte-bef7392c-230e-46c5-bbda-f3d85d21ea0f" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Lock "cinder-quobyte-bef7392c-230e-46c5-bbda-f3d85d21ea0f" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:41 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91c73f8-281a-4939-bf33-831f9d03bf8a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:41 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f Jul 31 10:55:41 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:41 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f" returned: 0 in 0.613s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:41 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f Jul 31 10:55:41 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:42 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bef7392c-230e-46c5-bbda-f3d85d21ea0f" returned: 0 in 0.433s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Lock "cinder-quobyte-bef7392c-230e-46c5-bbda-f3d85d21ea0f" released by "delete_volume" :: held 1.101s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:42 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Created reservations ['616212a1-d86a-4fde-b399-140dafd7c66f', '52c2b46f-1993-45df-b843-69d1a00b71a9', '43fd475e-0add-4194-9a63-b092e53bf14e', '732737b2-6226-4295-bb9c-81b5d71aae88'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:42 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:55:42 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:42 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.313s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:42 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Deleted volume successfully. Jul 31 10:55:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fc29700d-4c31-419d-be8b-3d8f6bad5930 tempest-ServersNegativeTestJSON-711113202 None] Lock "cinder-bef7392c-230e-46c5-bbda-f3d85d21ea0f-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Acquiring lock "cinder-cc95a8b7-ec53-4736-804f-6613476a8de9-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Lock "cinder-cc95a8b7-ec53-4736-804f-6613476a8de9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Acquiring lock "cinder-quobyte-cc95a8b7-ec53-4736-804f-6613476a8de9" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Lock "cinder-quobyte-cc95a8b7-ec53-4736-804f-6613476a8de9" acquired by "delete_volume" :: waited 0.031s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:43 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b164af-a30d-4199-aa8d-8854ab373f80]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc95a8b7-ec53-4736-804f-6613476a8de9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:43 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc95a8b7-ec53-4736-804f-6613476a8de9 Jul 31 10:55:43 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:44 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc95a8b7-ec53-4736-804f-6613476a8de9" returned: 0 in 0.478s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc95a8b7-ec53-4736-804f-6613476a8de9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:44 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc95a8b7-ec53-4736-804f-6613476a8de9 Jul 31 10:55:44 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:44 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc95a8b7-ec53-4736-804f-6613476a8de9" returned: 0 in 0.340s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Lock "cinder-quobyte-cc95a8b7-ec53-4736-804f-6613476a8de9" released by "delete_volume" :: held 0.887s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:44 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Created reservations ['1a3d151f-feab-4b8c-adc6-99439b17c695', 'd55f524d-29a5-447d-9baa-6f9b7cc6510b', '89a70cbe-8826-4eec-b803-589993aa59d4', 'ebf2cb17-131f-48cf-863b-0db250678471'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:44 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:55:44 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:45 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.265s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Deleted volume successfully. Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b630c560-1a0a-4aee-8bae-d50e2b328f72 tempest-ServersNegativeTestJSON-711113202 None] Lock "cinder-cc95a8b7-ec53-4736-804f-6613476a8de9-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Flow 'volume_create_manager' (f5cb1545-b2f8-430a-a5dc-467cd89e025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35e6b48-8995-47eb-a137-73f91b121ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35e6b48-8995-47eb-a137-73f91b121ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2046390002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43ebcfb-a475-4cb1-a91e-2f75e473cd65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9545a61afa4e77917acf93522aa43b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:45Z,use_quota=True,user_id='ff13a410e6e34033a903c66251c59bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daab807d-51ba-4ba2-8a85-2bcd7769ed97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daab807d-51ba-4ba2-8a85-2bcd7769ed97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61cb597-8768-4d7a-8552-f834e58bd567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61cb597-8768-4d7a-8552-f834e58bd567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43ebcfb-a475-4cb1-a91e-2f75e473cd65', 'volume_name': 'volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569a013c-a557-43ac-9bdb-e811096bd400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569a013c-a557-43ac-9bdb-e811096bd400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb7a299-401f-4264-8a94-fe011a1b2286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:45 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Volume e43ebcfb-a475-4cb1-a91e-2f75e473cd65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65', 'volume_size': 1} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2046390002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43ebcfb-a475-4cb1-a91e-2f75e473cd65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9545a61afa4e77917acf93522aa43b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:45Z,use_quota=True,user_id='ff13a410e6e34033a903c66251c59bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Creating volume e43ebcfb-a475-4cb1-a91e-2f75e473cd65 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:55:45 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:45 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65 1073741824 Jul 31 10:55:45 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:45 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65 1073741824" returned: 0 in 0.630s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:45 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65 Jul 31 10:55:45 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:46 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65" returned: 0 in 0.414s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb7a299-401f-4264-8a94-fe011a1b2286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c6293a-cc12-457f-ad9b-7c4ceb218ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:46 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Volume volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65 (e43ebcfb-a475-4cb1-a91e-2f75e473cd65): created successfully Jul 31 10:55:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c6293a-cc12-457f-ad9b-7c4ceb218ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Flow 'volume_create_manager' (f5cb1545-b2f8-430a-a5dc-467cd89e025d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:46 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-0fbdce90-b0ad-4ff7-95fc-fffc268041ac tempest-AttachVolumeTestJSON-760762861 None] Created volume successfully. Jul 31 10:55:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Acquiring lock "cinder-b6aaabe4-ff6e-456c-a049-e052ed1709a0-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Lock "cinder-b6aaabe4-ff6e-456c-a049-e052ed1709a0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Acquiring lock "cinder-quobyte-b6aaabe4-ff6e-456c-a049-e052ed1709a0" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Lock "cinder-quobyte-b6aaabe4-ff6e-456c-a049-e052ed1709a0" acquired by "delete_volume" :: waited 0.053s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:47 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ffd70-d85d-4fcb-a6e5-51c2c62af1fd]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:47 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0 Jul 31 10:55:47 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:47 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0" returned: 0 in 0.627s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:47 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0 Jul 31 10:55:47 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:48 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b6aaabe4-ff6e-456c-a049-e052ed1709a0" returned: 0 in 0.460s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Lock "cinder-quobyte-b6aaabe4-ff6e-456c-a049-e052ed1709a0" released by "delete_volume" :: held 1.163s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Created reservations ['fd085aca-3b77-42f4-b8b5-09a0a9ac930d', 'afd9182e-6bc6-44cb-941c-cdab7659229e', '90dc1d97-cd65-46fc-8e3c-440e6b2f97ee', '6243fb08-a189-48f5-aca0-3365ca5ddc94'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:48 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:55:48 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-a6f7782e-deb8-4355-ada6-0b9c4ae61028 req-e2156c13-9b53-40de-8a28-58dc4a307b28 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-a6f7782e-deb8-4355-ada6-0b9c4ae61028 req-e2156c13-9b53-40de-8a28-58dc4a307b28 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0030579-7050-4fd8-a887-da2f18de9739]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-a6f7782e-deb8-4355-ada6-0b9c4ae61028 req-e2156c13-9b53-40de-8a28-58dc4a307b28 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:48 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65 Jul 31 10:55:48 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:48 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.437s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:48 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Deleted volume successfully. Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b5f63ed0-f040-44fa-8eb8-a820d76e3410 tempest-VolumesNegativeTest-1013669154 None] Lock "cinder-b6aaabe4-ff6e-456c-a049-e052ed1709a0-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:48 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-a6f7782e-deb8-4355-ada6-0b9c4ae61028 req-e2156c13-9b53-40de-8a28-58dc4a307b28 tempest-AttachVolumeTestJSON-760762861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65" returned: 0 in 0.465s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-a6f7782e-deb8-4355-ada6-0b9c4ae61028 req-e2156c13-9b53-40de-8a28-58dc4a307b28 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.516s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-a6f7782e-deb8-4355-ada6-0b9c4ae61028 req-e2156c13-9b53-40de-8a28-58dc4a307b28 tempest-AttachVolumeTestJSON-760762861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5873957a-d81f-4b1e-a039-0df3fc5b3026', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:55:49 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-a6f7782e-deb8-4355-ada6-0b9c4ae61028 req-e2156c13-9b53-40de-8a28-58dc4a307b28 tempest-AttachVolumeTestJSON-760762861 None] attachment_update completed successfully. Jul 31 10:55:59 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=44,cinder:SELECT=36,cinder:INSERT=7,cinder:DELETE=4 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:55:59 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=34,cinder:UPDATE=34,cinder:INSERT=9,cinder:DELETE=3 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Flow 'volume_create_manager' (7757ac83-541e-4324-8aac-ab1f3946c12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ca047c-ee33-4c74-a9ed-f3fac7bd5860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ca047c-ee33-4c74-a9ed-f3fac7bd5860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-496542745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c86124-8c28-4d7b-bdfd-2363bad98396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f665aac91d2b40aca4713f006e24a03f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:02Z,use_quota=True,user_id='532a1c1fc9db481f8cbb6d8ff1747e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984725ba-620d-4d19-9795-59ac7eb82c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984725ba-620d-4d19-9795-59ac7eb82c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95fe3cb-6b56-4f62-8148-8c9f44c027d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95fe3cb-6b56-4f62-8148-8c9f44c027d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97c86124-8c28-4d7b-bdfd-2363bad98396', 'volume_name': 'volume-97c86124-8c28-4d7b-bdfd-2363bad98396', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a52df81-c5de-4f37-b355-847c8ee8fa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a52df81-c5de-4f37-b355-847c8ee8fa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b268d0-28fa-4450-8b78-abcd5ca10e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:02 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Volume 97c86124-8c28-4d7b-bdfd-2363bad98396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97c86124-8c28-4d7b-bdfd-2363bad98396', 'volume_size': 1} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-496542745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c86124-8c28-4d7b-bdfd-2363bad98396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f665aac91d2b40aca4713f006e24a03f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:02Z,use_quota=True,user_id='532a1c1fc9db481f8cbb6d8ff1747e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Creating volume 97c86124-8c28-4d7b-bdfd-2363bad98396 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:02 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:56:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:02 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 1073741824 Jul 31 10:56:02 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:03 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 1073741824" returned: 0 in 0.980s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:03 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 Jul 31 10:56:03 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:04 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396" returned: 0 in 0.562s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b268d0-28fa-4450-8b78-abcd5ca10e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c86124-8c28-4d7b-bdfd-2363bad98396', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8d49da-7ef8-4386-af13-81ff86a2f03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:04 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Volume volume-97c86124-8c28-4d7b-bdfd-2363bad98396 (97c86124-8c28-4d7b-bdfd-2363bad98396): created successfully Jul 31 10:56:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8d49da-7ef8-4386-af13-81ff86a2f03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Flow 'volume_create_manager' (7757ac83-541e-4324-8aac-ab1f3946c12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:04 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-ba48adf6-cbff-4a15-a6c4-decc7c807e30 req-10b48f8b-0c51-4f8f-a9c0-4905f89e0396 tempest-VolumesSnapshotsTestJSON-1284321886 None] Created volume successfully. Jul 31 10:56:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] Creating offline snapshot 3bb820fb-bd70-4e6d-aa31-e73491bf34f1 of volume 97c86124-8c28-4d7b-bdfd-2363bad98396 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:56:05 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[343dbe79-b68f-4c1f-84b2-9343d1162e16]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:05 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 Jul 31 10:56:05 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:05 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396" returned: 0 in 0.673s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:06 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 1G Jul 31 10:56:06 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:06 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 1G" returned: 0 in 0.984s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c86124-8c28-4d7b-bdfd-2363bad98396 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:07 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c86124-8c28-4d7b-bdfd-2363bad98396 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 Jul 31 10:56:07 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:07 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c86124-8c28-4d7b-bdfd-2363bad98396 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1" returned: 0 in 0.743s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:07 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 is being set with open permissions: ugo+rw Jul 31 10:56:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:07 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 Jul 31 10:56:07 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:08 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:56:08 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:08 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1" returned: 0 in 0.695s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:08 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.info Jul 31 10:56:08 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:08 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.707s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:56:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:56:09 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.info" returned: 0 in 0.566s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:09 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.info is being set with open permissions: ugo+rw Jul 31 10:56:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:09 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.info Jul 31 10:56:09 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:09 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.info" returned: 0 in 0.476s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.441s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:09 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-7255677b-5f2f-4d7d-a1f3-7cee766da476 req-aa515cf2-4517-42b6-b6aa-34e52b0e1195 tempest-VolumesSnapshotsTestJSON-1284321886 None] Create snapshot completed successfully Jul 31 10:56:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Acquiring lock "cinder-3bb820fb-bd70-4e6d-aa31-e73491bf34f1-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "cinder-3bb820fb-bd70-4e6d-aa31-e73491bf34f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Acquiring lock "cinder-quobyte-97c86124-8c28-4d7b-bdfd-2363bad98396" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "cinder-quobyte-97c86124-8c28-4d7b-bdfd-2363bad98396" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Acquiring lock "cinder-quobyte-3bb820fb-bd70-4e6d-aa31-e73491bf34f1" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "cinder-quobyte-3bb820fb-bd70-4e6d-aa31-e73491bf34f1" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Deleting offline snapshot 3bb820fb-bd70-4e6d-aa31-e73491bf34f1 of volume 97c86124-8c28-4d7b-bdfd-2363bad98396 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:56:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] snapshot_file for this snap is: volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:56:10 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b86c7f-e1d1-47c3-a056-bd5df52cde9d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:10 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 Jul 31 10:56:10 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:11 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1" returned: 0 in 0.686s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c86124-8c28-4d7b-bdfd-2363bad98396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:56:11 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9196a2-90ba-4a4a-b0f0-fef021797552]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:11 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 Jul 31 10:56:11 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:12 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396" returned: 0 in 0.691s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:12 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 Jul 31 10:56:12 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:12 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1" returned: 0 in 0.513s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:12 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1 Jul 31 10:56:12 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Flow 'volume_create_manager' (8b9dae0a-0e52-46f7-abc7-91cfecdc87da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc08ba9-60f6-42f1-8272-4e39e257f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:13 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc08ba9-60f6-42f1-8272-4e39e257f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-940258034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3427be9b-4dea-4a88-a6ec-e24b5647d987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84574e11078e45e88fa382711798ba0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:13Z,use_quota=True,user_id='299bd59caa27464486e6d24acb468571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366e7c92-859d-4b3d-acf0-22c3c7c2919f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366e7c92-859d-4b3d-acf0-22c3c7c2919f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13872df-e668-45c2-a1ca-69b335a290fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13872df-e668-45c2-a1ca-69b335a290fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3427be9b-4dea-4a88-a6ec-e24b5647d987', 'volume_name': 'volume-3427be9b-4dea-4a88-a6ec-e24b5647d987', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2489289e-0e40-415e-9987-946d1d9644d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2489289e-0e40-415e-9987-946d1d9644d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb381f4a-aca0-4d52-9a68-5597f13a6582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:13 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Volume 3427be9b-4dea-4a88-a6ec-e24b5647d987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3427be9b-4dea-4a88-a6ec-e24b5647d987', 'volume_size': 1} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-940258034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3427be9b-4dea-4a88-a6ec-e24b5647d987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84574e11078e45e88fa382711798ba0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:13Z,use_quota=True,user_id='299bd59caa27464486e6d24acb468571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Creating volume 3427be9b-4dea-4a88-a6ec-e24b5647d987 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:13 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396.3bb820fb-bd70-4e6d-aa31-e73491bf34f1" returned: 0 in 0.472s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:13 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 1073741824 Jul 31 10:56:13 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "cinder-quobyte-3bb820fb-bd70-4e6d-aa31-e73491bf34f1" released by "_delete_snapshot" :: held 2.543s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "cinder-quobyte-97c86124-8c28-4d7b-bdfd-2363bad98396" released by "delete_snapshot" :: held 2.590s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:13 devstack cinder-volume[89145]: WARNING cinder.quota [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.quota [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Created reservations ['0fb13db1-04d1-4d5e-acbe-41293ff459bb', 'f7364794-0fea-4e14-91f6-ac17861e8738', '46e28f9d-686f-4f49-90f7-5f8d4f06fc8b', '318db8eb-1f84-4927-963b-6e9f1fbbd99e'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:13 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Delete snapshot completed successfully. Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b5ad225c-c445-4456-a835-0e90953b0a81 req-3e6f126e-33eb-4b40-b29c-c1a83039b901 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "cinder-3bb820fb-bd70-4e6d-aa31-e73491bf34f1-delete_snapshot" released by "delete_snapshot" :: held 2.863s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:13 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 1073741824" returned: 0 in 0.501s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:13 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 Jul 31 10:56:13 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:14 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987" returned: 0 in 0.275s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb381f4a-aca0-4d52-9a68-5597f13a6582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3427be9b-4dea-4a88-a6ec-e24b5647d987', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae4f23a-7979-4359-b676-0c619b121b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:14 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Volume volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 (3427be9b-4dea-4a88-a6ec-e24b5647d987): created successfully Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae4f23a-7979-4359-b676-0c619b121b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Flow 'volume_create_manager' (8b9dae0a-0e52-46f7-abc7-91cfecdc87da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:14 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-57fdd667-22ef-4137-920e-98ae41c24486 tempest-VolumesSnapshotTestJSON-1268411013 None] Created volume successfully. Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Acquiring lock "cinder-97c86124-8c28-4d7b-bdfd-2363bad98396-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "cinder-97c86124-8c28-4d7b-bdfd-2363bad98396-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Acquiring lock "cinder-quobyte-97c86124-8c28-4d7b-bdfd-2363bad98396" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "cinder-quobyte-97c86124-8c28-4d7b-bdfd-2363bad98396" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[446da756-bb5a-4a95-bc1f-8092da40c3b8]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:14 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 Jul 31 10:56:14 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:14 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396" returned: 0 in 0.375s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:14 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396 Jul 31 10:56:14 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:14 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97c86124-8c28-4d7b-bdfd-2363bad98396" returned: 0 in 0.269s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "cinder-quobyte-97c86124-8c28-4d7b-bdfd-2363bad98396" released by "delete_volume" :: held 0.719s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG cinder.quota [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Created reservations ['7662cf20-d601-427b-bda3-199e85d2005d', '5306a3dc-ab33-419e-8296-8a731349f615', '398a703f-7aee-496e-8759-f47da74806cc', '05dfe9a7-b65a-4132-9b92-a7154de07d39'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:15 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:56:15 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:15 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.435s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG cinder.manager [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:15 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Deleted volume successfully. Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-a153517d-5335-4656-ab6c-41c92514d346 req-0593ea04-9c96-42c1-9d0d-dd996b53c9d7 tempest-VolumesSnapshotsTestJSON-1284321886 None] Lock "cinder-97c86124-8c28-4d7b-bdfd-2363bad98396-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] Creating offline snapshot c66ea0fa-c057-4a2d-b068-d093242fe1c0 of volume 3427be9b-4dea-4a88-a6ec-e24b5647d987 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1617484-c698-44e5-8760-5e24ae575dcd]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:16 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 Jul 31 10:56:16 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:16 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987" returned: 0 in 0.673s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:16 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 1G Jul 31 10:56:16 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:17 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 1G" returned: 0 in 0.663s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:17 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 Jul 31 10:56:17 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:17 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0" returned: 0 in 0.335s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:17 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 is being set with open permissions: ugo+rw Jul 31 10:56:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:17 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 Jul 31 10:56:17 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:17 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0" returned: 0 in 0.349s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:17 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.info Jul 31 10:56:17 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:18 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.info" returned: 0 in 0.266s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:18 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.info is being set with open permissions: ugo+rw Jul 31 10:56:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:18 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.info Jul 31 10:56:18 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:18 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.info" returned: 0 in 0.273s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.726s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:18 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f8ee8f36-51c3-47e5-99b6-18db66764f57 tempest-VolumesSnapshotTestJSON-1268411013 None] Create snapshot completed successfully Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-c66ea0fa-c057-4a2d-b068-d093242fe1c0-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-c66ea0fa-c057-4a2d-b068-d093242fe1c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-3427be9b-4dea-4a88-a6ec-e24b5647d987" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-3427be9b-4dea-4a88-a6ec-e24b5647d987" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-c66ea0fa-c057-4a2d-b068-d093242fe1c0" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-c66ea0fa-c057-4a2d-b068-d093242fe1c0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Deleting offline snapshot c66ea0fa-c057-4a2d-b068-d093242fe1c0 of volume 3427be9b-4dea-4a88-a6ec-e24b5647d987 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] snapshot_file for this snap is: volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e030ada-5b97-4475-9bf3-5b13067bfbc8]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:19 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 Jul 31 10:56:19 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:19 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0" returned: 0 in 0.449s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3427be9b-4dea-4a88-a6ec-e24b5647d987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f528ae7a-6bf8-4740-a3fd-bb12b5c495ee]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:19 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 Jul 31 10:56:19 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:20 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987" returned: 0 in 0.369s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:20 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 Jul 31 10:56:20 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:20 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0" returned: 0 in 0.409s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:20 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0 Jul 31 10:56:20 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:20 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a1dc9cfb-663c-44fa-9535-5a296d20a7d7 tempest-GroupsTest-1697400485 None] Group tempest-Group1-1926092516: creating Jul 31 10:56:20 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a1dc9cfb-663c-44fa-9535-5a296d20a7d7 tempest-GroupsTest-1697400485 None] Group tempest-Group1-1926092516: created successfully Jul 31 10:56:20 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a1dc9cfb-663c-44fa-9535-5a296d20a7d7 tempest-GroupsTest-1697400485 None] Create group completed successfully. Jul 31 10:56:20 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987.c66ea0fa-c057-4a2d-b068-d093242fe1c0" returned: 0 in 0.278s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-c66ea0fa-c057-4a2d-b068-d093242fe1c0" released by "_delete_snapshot" :: held 1.640s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-3427be9b-4dea-4a88-a6ec-e24b5647d987" released by "delete_snapshot" :: held 1.668s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:20 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Created reservations ['43756e7d-461f-476a-9a6b-81e7693885e3', '81dbe105-4cfb-457c-a954-6923f9fd3967', '1e38228e-0302-4a42-8afb-a353090f7930', '4bfa0a16-55e6-476a-8ec0-f7464eb6f69b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:20 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Delete snapshot completed successfully. Jul 31 10:56:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cfe16827-998b-4bef-bbbd-1465f7872905 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-c66ea0fa-c057-4a2d-b068-d093242fe1c0-delete_snapshot" released by "delete_snapshot" :: held 1.867s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Flow 'volume_create_manager' (b0078b89-fff7-4584-bf29-62af8249257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab43280-0d9b-45a7-b2c8-02985f85994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab43280-0d9b-45a7-b2c8-02985f85994f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1231979369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89f2351-42ce-47a3-ba3f-4facc3abc37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84574e11078e45e88fa382711798ba0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:22Z,use_quota=True,user_id='299bd59caa27464486e6d24acb468571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c9ae94-cb68-4b6d-bee2-23914f7a1e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c9ae94-cb68-4b6d-bee2-23914f7a1e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661fe25d-e66b-4751-9dde-c9572342b9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661fe25d-e66b-4751-9dde-c9572342b9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89f2351-42ce-47a3-ba3f-4facc3abc37e', 'volume_name': 'volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a95cbab-8568-475d-9f29-a1d38439d888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a95cbab-8568-475d-9f29-a1d38439d888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8160e13-94da-43c8-9732-3e1a031daec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:21 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Volume a89f2351-42ce-47a3-ba3f-4facc3abc37e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e', 'volume_size': 1} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1231979369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89f2351-42ce-47a3-ba3f-4facc3abc37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84574e11078e45e88fa382711798ba0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:22Z,use_quota=True,user_id='299bd59caa27464486e6d24acb468571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Creating volume a89f2351-42ce-47a3-ba3f-4facc3abc37e {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:21 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:56:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:21 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e 1073741824 Jul 31 10:56:21 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:22 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7d348d76-96d8-45e1-a6b7-9808b5f597f0 tempest-GroupsTest-1697400485 None] Group tempest-Group2-587721953: creating Jul 31 10:56:22 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7d348d76-96d8-45e1-a6b7-9808b5f597f0 tempest-GroupsTest-1697400485 None] Group tempest-Group2-587721953: created successfully Jul 31 10:56:22 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7d348d76-96d8-45e1-a6b7-9808b5f597f0 tempest-GroupsTest-1697400485 None] Create group completed successfully. Jul 31 10:56:22 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e 1073741824" returned: 0 in 0.496s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:22 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e Jul 31 10:56:22 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:22 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e" returned: 0 in 0.267s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8160e13-94da-43c8-9732-3e1a031daec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bfe534f-a57d-4668-a18d-276c23d9f218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:22 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Volume volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e (a89f2351-42ce-47a3-ba3f-4facc3abc37e): created successfully Jul 31 10:56:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bfe534f-a57d-4668-a18d-276c23d9f218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Flow 'volume_create_manager' (b0078b89-fff7-4584-bf29-62af8249257b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:22 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-069ed490-bde0-4d36-b1e1-453cda3de2b0 tempest-VolumesSnapshotTestJSON-1268411013 None] Created volume successfully. Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Flow 'volume_create_manager' (75dc73cd-1113-4691-8b79-09c9a832c862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c94e1d9-15d6-41b4-8e02-7ae6caa70e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c94e1d9-15d6-41b4-8e02-7ae6caa70e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2031655370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bcb6c551-6bb5-419a-a1ac-2200dd6ed606,host='devstack@QuobyteHD#QuobyteHD',id=7f6be7a8-2868-4dca-ba44-21a5a915bc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5157e8b384e6db466f3ea6f12a9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:24Z,use_quota=True,user_id='ae21d70de93346929bf56fce39993282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42ee978f-cb32-498d-9ea3-e91c8bee67ed),volume_type_id=42ee978f-cb32-498d-9ea3-e91c8bee67ed)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55aaab9-141b-46c3-9228-4a2f91c8e172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55aaab9-141b-46c3-9228-4a2f91c8e172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acfe7e06-896e-4818-8c25-e163597069b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acfe7e06-896e-4818-8c25-e163597069b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f6be7a8-2868-4dca-ba44-21a5a915bc07', 'volume_name': 'volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4411cf6-e198-4773-b0f1-b1d3f54e6d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4411cf6-e198-4773-b0f1-b1d3f54e6d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dbedbb-65b5-4a6d-adfd-266ec44d754d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:23 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Volume 7f6be7a8-2868-4dca-ba44-21a5a915bc07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07', 'volume_size': 1} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bcb6c551-6bb5-419a-a1ac-2200dd6ed606,created_at=2026-07-31T08:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2031655370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bcb6c551-6bb5-419a-a1ac-2200dd6ed606,host='devstack@QuobyteHD#QuobyteHD',id=7f6be7a8-2868-4dca-ba44-21a5a915bc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5157e8b384e6db466f3ea6f12a9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:24Z,use_quota=True,user_id='ae21d70de93346929bf56fce39993282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42ee978f-cb32-498d-9ea3-e91c8bee67ed),volume_type_id=42ee978f-cb32-498d-9ea3-e91c8bee67ed)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Creating volume 7f6be7a8-2868-4dca-ba44-21a5a915bc07 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:23 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:56:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:23 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07 1073741824 Jul 31 10:56:23 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:24 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07 1073741824" returned: 0 in 0.534s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:24 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07 Jul 31 10:56:24 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:24 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07" returned: 0 in 0.281s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.457s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] Creating offline snapshot 40317bff-17e7-4f81-9cfe-839f97230a92 of volume a89f2351-42ce-47a3-ba3f-4facc3abc37e {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dbedbb-65b5-4a6d-adfd-266ec44d754d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcf3fc6-63ae-4ea3-a523-15c0d1616d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea20a03e-f048-425a-a00b-7e7f7e741102]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:24 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Volume volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07 (7f6be7a8-2868-4dca-ba44-21a5a915bc07): created successfully Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcf3fc6-63ae-4ea3-a523-15c0d1616d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Flow 'volume_create_manager' (75dc73cd-1113-4691-8b79-09c9a832c862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:24 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-5e544f5a-ef0e-4b3c-a944-39f49a015207 tempest-GroupsTest-1697400485 None] Created volume successfully. Jul 31 10:56:24 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e Jul 31 10:56:24 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:25 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e" returned: 0 in 0.539s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:25 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 1G Jul 31 10:56:25 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:25 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Acquiring lock "cinder-quobyte-7f6be7a8-2868-4dca-ba44-21a5a915bc07" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:25 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Lock "cinder-quobyte-7f6be7a8-2868-4dca-ba44-21a5a915bc07" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:25 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[682dbfa0-8d6e-4aa2-870d-cbcef039cfc9]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:25 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07 Jul 31 10:56:25 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:25 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 1G" returned: 0 in 0.685s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:25 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 Jul 31 10:56:25 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:26 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07" returned: 0 in 0.532s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:26 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07 Jul 31 10:56:26 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:26 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92" returned: 0 in 0.446s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:26 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 is being set with open permissions: ugo+rw Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:26 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 Jul 31 10:56:26 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:26 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7f6be7a8-2868-4dca-ba44-21a5a915bc07" returned: 0 in 0.377s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Lock "cinder-quobyte-7f6be7a8-2868-4dca-ba44-21a5a915bc07" released by "delete_volume" :: held 0.977s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:26 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92" returned: 0 in 0.349s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:26 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.info Jul 31 10:56:26 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Created reservations ['85e99790-f348-4817-b00e-8860e0d589b9'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:26 devstack cinder-volume[89145]: WARNING cinder.quota [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1731626496 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1731626496, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:56:26 devstack cinder-volume[89145]: WARNING cinder.quota [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1731626496 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1731626496, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Flow 'volume_create_manager' (33fe110a-f70b-4b94-a003-f431d94bd738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f26d6b0-cc47-4729-be67-843cf3802c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f26d6b0-cc47-4729-be67-843cf3802c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1867108777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00014096-e26c-4c06-b7aa-996fa7f55ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4712355490f4f00bb2d4efb6e8539e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:27Z,use_quota=True,user_id='7e8a5d6951f64559a52ae4f46330b63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27052460-beb7-479a-bc74-52ba9b8738f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27052460-beb7-479a-bc74-52ba9b8738f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8708b54-6bc5-4ccb-ab8b-83a6f4105a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8708b54-6bc5-4ccb-ab8b-83a6f4105a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00014096-e26c-4c06-b7aa-996fa7f55ddf', 'volume_name': 'volume-00014096-e26c-4c06-b7aa-996fa7f55ddf', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef71a0c-7b64-4921-9bff-958e2b610552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef71a0c-7b64-4921-9bff-958e2b610552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e2178b-3621-4ff3-afb6-2e5388cd4a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:26 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Volume 00014096-e26c-4c06-b7aa-996fa7f55ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00014096-e26c-4c06-b7aa-996fa7f55ddf', 'volume_size': 1} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Created reservations ['b9de00bc-be60-43fc-9781-02d0f37290b7', 'd023c3fe-d16d-4900-907f-0e00058cbce2', '4a37133b-624c-4ad2-b238-808e7af93abf', '56eacee2-7638-47a0-947a-60afc92be8e1'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:26 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.info" returned: 0 in 0.309s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:27 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.info is being set with open permissions: ugo+rw Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:27 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:56:27 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:27 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.info Jul 31 10:56:27 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:27 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.info" returned: 0 in 0.257s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:27 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.711s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.426s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1867108777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00014096-e26c-4c06-b7aa-996fa7f55ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4712355490f4f00bb2d4efb6e8539e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:27Z,use_quota=True,user_id='7e8a5d6951f64559a52ae4f46330b63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Creating volume 00014096-e26c-4c06-b7aa-996fa7f55ddf {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:27 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.321s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:27 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d8d6f259-78a5-4f42-84d1-3f31dca2e8a3 tempest-GroupsTest-1697400485 None] Delete group completed successfully. Jul 31 10:56:27 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf 1073741824 Jul 31 10:56:27 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:27 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-dd3ad318-bdfd-438a-aae9-7fbf43bd4446 tempest-VolumesSnapshotTestJSON-1268411013 None] Create snapshot completed successfully Jul 31 10:56:27 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf 1073741824" returned: 0 in 0.486s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:27 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf Jul 31 10:56:27 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:28 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf" returned: 0 in 0.313s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e2178b-3621-4ff3-afb6-2e5388cd4a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00014096-e26c-4c06-b7aa-996fa7f55ddf', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c031083f-5303-47ef-8848-58256b8dc220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:28 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Volume volume-00014096-e26c-4c06-b7aa-996fa7f55ddf (00014096-e26c-4c06-b7aa-996fa7f55ddf): created successfully Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c031083f-5303-47ef-8848-58256b8dc220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Flow 'volume_create_manager' (33fe110a-f70b-4b94-a003-f431d94bd738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:28 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-da6414bc-cf5b-41bc-b487-f8d63a0968e2 tempest-AttachVolumeNegativeTest-1174809077 None] Created volume successfully. Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3914e6fa-a55b-4756-ad0d-4acedbeefdb9 tempest-GroupsTest-1697400485 None] Created reservations ['f771865b-5566-4ef0-a439-edda21d18875'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3914e6fa-a55b-4756-ad0d-4acedbeefdb9 tempest-GroupsTest-1697400485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3914e6fa-a55b-4756-ad0d-4acedbeefdb9 tempest-GroupsTest-1697400485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3914e6fa-a55b-4756-ad0d-4acedbeefdb9 tempest-GroupsTest-1697400485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3914e6fa-a55b-4756-ad0d-4acedbeefdb9 tempest-GroupsTest-1697400485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3914e6fa-a55b-4756-ad0d-4acedbeefdb9 tempest-GroupsTest-1697400485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3914e6fa-a55b-4756-ad0d-4acedbeefdb9 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:28 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:56:28 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:28 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3914e6fa-a55b-4756-ad0d-4acedbeefdb9 tempest-GroupsTest-1697400485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.285s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-3914e6fa-a55b-4756-ad0d-4acedbeefdb9 tempest-GroupsTest-1697400485 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:28 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3914e6fa-a55b-4756-ad0d-4acedbeefdb9 tempest-GroupsTest-1697400485 None] Delete group completed successfully. Jul 31 10:56:28 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Flow 'volume_create_manager' (b102c22a-21a5-4d35-bea2-6fd8b500de4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d2f1d4-639f-4c8a-ac98-7e30ee149c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d2f1d4-639f-4c8a-ac98-7e30ee149c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1350516651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6117a3-0987-40a2-bc57-a481f300cffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84574e11078e45e88fa382711798ba0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=40317bff-17e7-4f81-9cfe-839f97230a92,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:29Z,use_quota=True,user_id='299bd59caa27464486e6d24acb468571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c66139-f6dc-4558-9c22-c2b8fff64217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c66139-f6dc-4558-9c22-c2b8fff64217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe3c91c-048c-4467-bd30-b5cbe925e9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe3c91c-048c-4467-bd30-b5cbe925e9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3d6117a3-0987-40a2-bc57-a481f300cffe', 'volume_name': 'volume-3d6117a3-0987-40a2-bc57-a481f300cffe', 'volume_size': 2, 'snapshot_id': '40317bff-17e7-4f81-9cfe-839f97230a92'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea24457-8f7b-4bd4-bf21-005c364b986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea24457-8f7b-4bd4-bf21-005c364b986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a828a7e-9383-4b60-a9be-97fd7124eb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:29 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Volume 3d6117a3-0987-40a2-bc57-a481f300cffe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3d6117a3-0987-40a2-bc57-a481f300cffe', 'volume_size': 2, 'snapshot_id': '40317bff-17e7-4f81-9cfe-839f97230a92'} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-40317bff-17e7-4f81-9cfe-839f97230a92-3d6117a3-0987-40a2-bc57-a481f300cffe" by "_create_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-876fac27-b1b0-4218-9f9d-1d339a62c554 req-ba449d9a-7562-4648-ac45-80e76519aeaa tempest-AttachVolumeTestJSON-760762861 None] Terminate volume connection completed successfully. Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-876fac27-b1b0-4218-9f9d-1d339a62c554 req-ba449d9a-7562-4648-ac45-80e76519aeaa tempest-AttachVolumeTestJSON-760762861 None] Deleting attachment 5873957a-d81f-4b1e-a039-0df3fc5b3026. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-40317bff-17e7-4f81-9cfe-839f97230a92-3d6117a3-0987-40a2-bc57-a481f300cffe" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Creating volume 3d6117a3-0987-40a2-bc57-a481f300cffe from snapshot 40317bff-17e7-4f81-9cfe-839f97230a92 {{(pid=89145) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-3d6117a3-0987-40a2-bc57-a481f300cffe" by "_copy_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-3d6117a3-0987-40a2-bc57-a481f300cffe" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] snapshot: 40317bff-17e7-4f81-9cfe-839f97230a92, volume: 3d6117a3-0987-40a2-bc57-a481f300cffe, {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcaee2c-fc0e-4553-a445-f090be687357]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:29 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 Jul 31 10:56:29 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:29 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92" returned: 0 in 0.630s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Creating direct copy from snapshot {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9c1eb7-141c-4c87-8bae-b22db695935e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:30 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e Jul 31 10:56:30 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:30 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-790d4ef0-ebf1-4874-83a1-4ab4bad0a1a6 tempest-GroupsTest-1697400485 None] Group tempest-GroupsTest-Group-735245731: creating Jul 31 10:56:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-6d0798f5-e692-4e07-9fbe-c10c402add0d req-0ee8cb07-a92c-4a07-a4e4-71dcc8ce7608 tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:30 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-790d4ef0-ebf1-4874-83a1-4ab4bad0a1a6 tempest-GroupsTest-1697400485 None] Group tempest-GroupsTest-Group-735245731: created successfully Jul 31 10:56:30 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-790d4ef0-ebf1-4874-83a1-4ab4bad0a1a6 tempest-GroupsTest-1697400485 None] Create group completed successfully. Jul 31 10:56:30 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e" returned: 0 in 0.487s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:30 devstack cinder-volume[89145]: DEBUG cinder.utils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Path /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe not found in is_blk_device check {{(pid=89145) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:56:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:30 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe Jul 31 10:56:30 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:32 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Flow 'volume_create_manager' (7a70e6b4-1594-481d-8d19-03560d321e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0402ff-24ee-4f05-a713-e38b436f96b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0402ff-24ee-4f05-a713-e38b436f96b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-507265071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=695a398b-0e50-4b32-b4b1-6734302c77f4,host='devstack@QuobyteHD#QuobyteHD',id=3f78430f-ac5e-44d9-9246-43b552df7ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5157e8b384e6db466f3ea6f12a9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:33Z,use_quota=True,user_id='ae21d70de93346929bf56fce39993282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4710c66-8d2d-4c76-aac5-66def53bea3d),volume_type_id=f4710c66-8d2d-4c76-aac5-66def53bea3d)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bac4b6-2e84-4743-ae15-64c236aac66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bac4b6-2e84-4743-ae15-64c236aac66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c30b8f-4460-4456-ba92-5d8e8d8bd954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c30b8f-4460-4456-ba92-5d8e8d8bd954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f78430f-ac5e-44d9-9246-43b552df7ccd', 'volume_name': 'volume-3f78430f-ac5e-44d9-9246-43b552df7ccd', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfcdd61-1ba9-42c0-8308-0627759ca619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfcdd61-1ba9-42c0-8308-0627759ca619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b482112-76b9-43dc-9c7b-4620fa06bf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:33 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Volume 3f78430f-ac5e-44d9-9246-43b552df7ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f78430f-ac5e-44d9-9246-43b552df7ccd', 'volume_size': 1} Jul 31 10:56:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe" returned: 0 in 5.863s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:36 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9930385e-2dde-4c55-b282-94fe9838cd22]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:36 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e Jul 31 10:56:36 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:37 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e" returned: 0 in 0.779s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:56:37 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Converted 1024.00 MB image at 174.62 MB/s Jul 31 10:56:37 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe is being set with open permissions: ugo+rw Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:37 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe Jul 31 10:56:37 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:37 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe" returned: 0 in 0.301s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-3d6117a3-0987-40a2-bc57-a481f300cffe" released by "_copy_volume_from_snapshot" :: held 8.252s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-40317bff-17e7-4f81-9cfe-839f97230a92-3d6117a3-0987-40a2-bc57-a481f300cffe" released by "_create_volume_from_snapshot" :: held 8.291s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.318s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-6d0798f5-e692-4e07-9fbe-c10c402add0d req-0ee8cb07-a92c-4a07-a4e4-71dcc8ce7608 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.176s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[912b0892-4788-4fd5-bbca-1c7dca4b794b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-6d0798f5-e692-4e07-9fbe-c10c402add0d req-0ee8cb07-a92c-4a07-a4e4-71dcc8ce7608 tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a828a7e-9383-4b60-a9be-97fd7124eb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d6117a3-0987-40a2-bc57-a481f300cffe', 'volume_size': 2, 'snapshot_id': '40317bff-17e7-4f81-9cfe-839f97230a92'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6331cb-4cb5-4ebf-b57d-2dc87630d7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:37 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Volume volume-3d6117a3-0987-40a2-bc57-a481f300cffe (3d6117a3-0987-40a2-bc57-a481f300cffe): created successfully Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6331cb-4cb5-4ebf-b57d-2dc87630d7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Flow 'volume_create_manager' (b102c22a-21a5-4d35-bea2-6fd8b500de4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:37 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4e508a08-436d-4b13-891f-edfdac474f73 tempest-VolumesSnapshotTestJSON-1268411013 None] Created volume successfully. Jul 31 10:56:37 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf Jul 31 10:56:37 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-3d6117a3-0987-40a2-bc57-a481f300cffe-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-3d6117a3-0987-40a2-bc57-a481f300cffe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-3d6117a3-0987-40a2-bc57-a481f300cffe" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-3d6117a3-0987-40a2-bc57-a481f300cffe" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[90482506-c7ef-46b7-ac79-92a200405676]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:38 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-6d0798f5-e692-4e07-9fbe-c10c402add0d req-0ee8cb07-a92c-4a07-a4e4-71dcc8ce7608 tempest-AttachVolumeNegativeTest-1174809077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf" returned: 0 in 0.553s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-6d0798f5-e692-4e07-9fbe-c10c402add0d req-0ee8cb07-a92c-4a07-a4e4-71dcc8ce7608 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.583s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.774s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=695a398b-0e50-4b32-b4b1-6734302c77f4,created_at=2026-07-31T08:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-507265071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=695a398b-0e50-4b32-b4b1-6734302c77f4,host='devstack@QuobyteHD#QuobyteHD',id=3f78430f-ac5e-44d9-9246-43b552df7ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5157e8b384e6db466f3ea6f12a9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:33Z,use_quota=True,user_id='ae21d70de93346929bf56fce39993282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4710c66-8d2d-4c76-aac5-66def53bea3d),volume_type_id=f4710c66-8d2d-4c76-aac5-66def53bea3d)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Creating volume 3f78430f-ac5e-44d9-9246-43b552df7ccd {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:38 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f78430f-ac5e-44d9-9246-43b552df7ccd 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:38 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f78430f-ac5e-44d9-9246-43b552df7ccd 1073741824 Jul 31 10:56:38 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-6d0798f5-e692-4e07-9fbe-c10c402add0d req-0ee8cb07-a92c-4a07-a4e4-71dcc8ce7608 tempest-AttachVolumeNegativeTest-1174809077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-00014096-e26c-4c06-b7aa-996fa7f55ddf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0e23d09-4d31-432b-9d75-d24d93c2834e', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:56:38 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe Jul 31 10:56:38 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-6d0798f5-e692-4e07-9fbe-c10c402add0d req-0ee8cb07-a92c-4a07-a4e4-71dcc8ce7608 tempest-AttachVolumeNegativeTest-1174809077 None] attachment_update completed successfully. Jul 31 10:56:38 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe" returned: 0 in 0.494s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:38 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe Jul 31 10:56:38 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:38 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f78430f-ac5e-44d9-9246-43b552df7ccd 1073741824" returned: 0 in 0.803s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f78430f-ac5e-44d9-9246-43b552df7ccd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:38 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f78430f-ac5e-44d9-9246-43b552df7ccd Jul 31 10:56:38 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:38 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3d6117a3-0987-40a2-bc57-a481f300cffe" returned: 0 in 0.510s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-3d6117a3-0987-40a2-bc57-a481f300cffe" released by "delete_volume" :: held 1.077s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Created reservations ['1304c966-09a0-48c6-acdc-f5d1d2b6dbcc', '3ba1d29e-b8ec-4d3a-9e1e-9094c64f0068', 'a6c40861-9fb6-4efb-8706-cb49794f3720', '995bed5b-b0ed-4dd9-8d16-7307d88c5614'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:39 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:56:39 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:39 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f78430f-ac5e-44d9-9246-43b552df7ccd" returned: 0 in 0.381s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b482112-76b9-43dc-9c7b-4620fa06bf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f78430f-ac5e-44d9-9246-43b552df7ccd', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b25b62da-5a39-439e-ba77-a6eeef062cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:39 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Volume volume-3f78430f-ac5e-44d9-9246-43b552df7ccd (3f78430f-ac5e-44d9-9246-43b552df7ccd): created successfully Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b25b62da-5a39-439e-ba77-a6eeef062cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Flow 'volume_create_manager' (7a70e6b4-1594-481d-8d19-03560d321e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-effdd00d-c0f1-4dba-95e2-ced6bb0340a1 tempest-GroupsTest-1697400485 None] Created volume successfully. Jul 31 10:56:39 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.419s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Deleted volume successfully. Jul 31 10:56:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a17a665d-3e14-4a13-a6a5-72a49adccd08 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-3d6117a3-0987-40a2-bc57-a481f300cffe-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-40317bff-17e7-4f81-9cfe-839f97230a92-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-40317bff-17e7-4f81-9cfe-839f97230a92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-a89f2351-42ce-47a3-ba3f-4facc3abc37e" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-a89f2351-42ce-47a3-ba3f-4facc3abc37e" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-40317bff-17e7-4f81-9cfe-839f97230a92" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-40317bff-17e7-4f81-9cfe-839f97230a92" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Deleting offline snapshot 40317bff-17e7-4f81-9cfe-839f97230a92 of volume a89f2351-42ce-47a3-ba3f-4facc3abc37e {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] snapshot_file for this snap is: volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f05e325-a209-413d-91c6-e9edfd7fa0ad]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:40 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 Jul 31 10:56:40 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Flow 'volume_create_manager' (5039afa9-1b35-4458-b2a7-3f7b8272d30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236cf5a3-c328-4777-8b92-8dff7bf2b607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236cf5a3-c328-4777-8b92-8dff7bf2b607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1937591878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=695a398b-0e50-4b32-b4b1-6734302c77f4,host='devstack@QuobyteHD#QuobyteHD',id=64c7735e-88d6-410d-9964-ac2634fc67e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5157e8b384e6db466f3ea6f12a9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:41Z,use_quota=True,user_id='ae21d70de93346929bf56fce39993282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4710c66-8d2d-4c76-aac5-66def53bea3d),volume_type_id=f4710c66-8d2d-4c76-aac5-66def53bea3d)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feeeba05-6edf-4296-89ba-763e8ec6dce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feeeba05-6edf-4296-89ba-763e8ec6dce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9942316-388e-4ba0-98bd-b5bb4c33c789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9942316-388e-4ba0-98bd-b5bb4c33c789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c7735e-88d6-410d-9964-ac2634fc67e5', 'volume_name': 'volume-64c7735e-88d6-410d-9964-ac2634fc67e5', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2391c002-7258-4268-af38-3ee2c54082fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2391c002-7258-4268-af38-3ee2c54082fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a16982-8436-47c4-847f-2e77c4879c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:41 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Volume 64c7735e-88d6-410d-9964-ac2634fc67e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c7735e-88d6-410d-9964-ac2634fc67e5', 'volume_size': 1} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=695a398b-0e50-4b32-b4b1-6734302c77f4,created_at=2026-07-31T08:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1937591878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=695a398b-0e50-4b32-b4b1-6734302c77f4,host='devstack@QuobyteHD#QuobyteHD',id=64c7735e-88d6-410d-9964-ac2634fc67e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd5157e8b384e6db466f3ea6f12a9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:41Z,use_quota=True,user_id='ae21d70de93346929bf56fce39993282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4710c66-8d2d-4c76-aac5-66def53bea3d),volume_type_id=f4710c66-8d2d-4c76-aac5-66def53bea3d)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Creating volume 64c7735e-88d6-410d-9964-ac2634fc67e5 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:41 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-64c7735e-88d6-410d-9964-ac2634fc67e5 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:41 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-64c7735e-88d6-410d-9964-ac2634fc67e5 1073741824 Jul 31 10:56:41 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:41 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92" returned: 0 in 0.570s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d1e7ac-3d81-4afb-8776-aa2301095cd7]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:41 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e Jul 31 10:56:41 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:41 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-495f780d-0bcd-4fc5-8794-b25b3c375a62 req-689d2ab9-a1a4-478a-bd92-d1e88240de7b tempest-AttachVolumeNegativeTest-1174809077 None] Terminate volume connection completed successfully. Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-495f780d-0bcd-4fc5-8794-b25b3c375a62 req-689d2ab9-a1a4-478a-bd92-d1e88240de7b tempest-AttachVolumeNegativeTest-1174809077 None] Deleting attachment f0e23d09-4d31-432b-9d75-d24d93c2834e. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:56:41 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:41 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e" returned: 0 in 0.546s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-64c7735e-88d6-410d-9964-ac2634fc67e5 1073741824" returned: 0 in 0.687s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:41 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 Jul 31 10:56:41 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-64c7735e-88d6-410d-9964-ac2634fc67e5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:41 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-64c7735e-88d6-410d-9964-ac2634fc67e5 Jul 31 10:56:41 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:42 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-64c7735e-88d6-410d-9964-ac2634fc67e5" returned: 0 in 0.446s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a16982-8436-47c4-847f-2e77c4879c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c7735e-88d6-410d-9964-ac2634fc67e5', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:42 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3396cd-4deb-4f63-93a7-56bd8bb74f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92" returned: 0 in 0.561s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:42 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Volume volume-64c7735e-88d6-410d-9964-ac2634fc67e5 (64c7735e-88d6-410d-9964-ac2634fc67e5): created successfully Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3396cd-4deb-4f63-93a7-56bd8bb74f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Flow 'volume_create_manager' (5039afa9-1b35-4458-b2a7-3f7b8272d30e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:42 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92 Jul 31 10:56:42 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9f7a6cc6-bd4e-48eb-8a92-c226f8d98291 tempest-GroupsTest-1697400485 None] Created volume successfully. Jul 31 10:56:42 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e.40317bff-17e7-4f81-9cfe-839f97230a92" returned: 0 in 0.450s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-40317bff-17e7-4f81-9cfe-839f97230a92" released by "_delete_snapshot" :: held 2.338s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-a89f2351-42ce-47a3-ba3f-4facc3abc37e" released by "delete_snapshot" :: held 2.383s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Created reservations ['cd00c793-f721-48da-9684-b1d3199a2231', 'c68b18e7-77e1-4548-b2e4-d3855f531c1e', '7aacfeaf-1754-4114-960a-ec65eb42fa01', 'a6159c7a-0ed2-446b-93e0-622eac781f66'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Delete snapshot completed successfully. Jul 31 10:56:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b3b7e0f0-33f3-4062-b554-9fb9030be3f7 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-40317bff-17e7-4f81-9cfe-839f97230a92-delete_snapshot" released by "delete_snapshot" :: held 2.601s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:43 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8e43239b-a505-412e-8bff-6be8aef84261 tempest-GroupsTest-1697400485 None] Update group completed successfully. Jul 31 10:56:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-a89f2351-42ce-47a3-ba3f-4facc3abc37e-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-a89f2351-42ce-47a3-ba3f-4facc3abc37e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-a89f2351-42ce-47a3-ba3f-4facc3abc37e" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-a89f2351-42ce-47a3-ba3f-4facc3abc37e" acquired by "delete_volume" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:44 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac7057a-68c7-431b-8cbd-d2a50522d2bd]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:44 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e Jul 31 10:56:44 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:44 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e" returned: 0 in 0.424s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:44 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e Jul 31 10:56:44 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:44 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a89f2351-42ce-47a3-ba3f-4facc3abc37e" returned: 0 in 0.350s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-a89f2351-42ce-47a3-ba3f-4facc3abc37e" released by "delete_volume" :: held 0.859s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:44 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Created reservations ['3d45298f-e8f2-4049-82b4-06bff1d966b2', '75eef916-7a9f-40af-a3c7-e5678d250248', 'cc0e3da5-4cf7-4fb8-92af-a35cb645ac76', '6a4886b9-8cb0-477e-8110-fb12051f394f'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:45 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:56:45 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ef22482e-9997-4298-bea6-1b952c016466 tempest-GroupsTest-1697400485 None] Update group completed successfully. Jul 31 10:56:45 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.381s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Deleted volume successfully. Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b55978dc-9994-44ff-93a9-7dc4b68849a6 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-a89f2351-42ce-47a3-ba3f-4facc3abc37e-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Flow 'volume_create_manager' (c5efec9b-06a3-4f0b-a6ec-43d6249a0da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d99b05e-d18e-4e2e-bf4c-268370901286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d99b05e-d18e-4e2e-bf4c-268370901286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-894098540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7d5cab-b464-4ff0-8d13-7207af599823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84574e11078e45e88fa382711798ba0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:46Z,use_quota=True,user_id='299bd59caa27464486e6d24acb468571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b46a93c-d55b-49c2-8eb8-f033838f1e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b46a93c-d55b-49c2-8eb8-f033838f1e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e22b9c1-d388-4def-a4e5-069465cb7277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e22b9c1-d388-4def-a4e5-069465cb7277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a7d5cab-b464-4ff0-8d13-7207af599823', 'volume_name': 'volume-5a7d5cab-b464-4ff0-8d13-7207af599823', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa46e71-920f-45c0-bbad-0f1079be5f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa46e71-920f-45c0-bbad-0f1079be5f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be0b837-9d4e-4c8f-aa4e-4f7df4189be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:45 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Volume 5a7d5cab-b464-4ff0-8d13-7207af599823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a7d5cab-b464-4ff0-8d13-7207af599823', 'volume_size': 1} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-894098540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7d5cab-b464-4ff0-8d13-7207af599823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84574e11078e45e88fa382711798ba0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:46Z,use_quota=True,user_id='299bd59caa27464486e6d24acb468571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Creating volume 5a7d5cab-b464-4ff0-8d13-7207af599823 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:45 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:56:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:45 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 1073741824 Jul 31 10:56:45 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:46 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 1073741824" returned: 0 in 0.598s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:46 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 Jul 31 10:56:46 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:47 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823" returned: 0 in 0.422s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be0b837-9d4e-4c8f-aa4e-4f7df4189be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7d5cab-b464-4ff0-8d13-7207af599823', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3bf530-353b-4326-b438-17e0c9b27b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:47 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Volume volume-5a7d5cab-b464-4ff0-8d13-7207af599823 (5a7d5cab-b464-4ff0-8d13-7207af599823): created successfully Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3bf530-353b-4326-b438-17e0c9b27b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Flow 'volume_create_manager' (c5efec9b-06a3-4f0b-a6ec-43d6249a0da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:47 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-75e455b3-58c1-4a00-b6ba-f4680b8791b1 tempest-VolumesSnapshotTestJSON-1268411013 None] Created volume successfully. Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Acquiring lock "cinder-quobyte-3f78430f-ac5e-44d9-9246-43b552df7ccd" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Lock "cinder-quobyte-3f78430f-ac5e-44d9-9246-43b552df7ccd" acquired by "delete_volume" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3336fd8b-df6c-4259-be97-75e6b3dce5be]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f78430f-ac5e-44d9-9246-43b552df7ccd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:47 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f78430f-ac5e-44d9-9246-43b552df7ccd Jul 31 10:56:47 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "cinder-00014096-e26c-4c06-b7aa-996fa7f55ddf-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "cinder-00014096-e26c-4c06-b7aa-996fa7f55ddf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "cinder-quobyte-00014096-e26c-4c06-b7aa-996fa7f55ddf" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "cinder-quobyte-00014096-e26c-4c06-b7aa-996fa7f55ddf" acquired by "delete_volume" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:47 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f78430f-ac5e-44d9-9246-43b552df7ccd" returned: 0 in 0.552s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f78430f-ac5e-44d9-9246-43b552df7ccd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b60f8ce-10ca-49f2-b7f1-c6d89d65be35]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:47 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f78430f-ac5e-44d9-9246-43b552df7ccd Jul 31 10:56:47 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:48 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf Jul 31 10:56:48 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] Creating offline snapshot 95b47bbb-f5e0-4644-9e6e-ca85d33791c2 of volume 5a7d5cab-b464-4ff0-8d13-7207af599823 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:56:48 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f78430f-ac5e-44d9-9246-43b552df7ccd" returned: 0 in 0.401s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Lock "cinder-quobyte-3f78430f-ac5e-44d9-9246-43b552df7ccd" released by "delete_volume" :: held 1.011s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Acquiring lock "cinder-quobyte-64c7735e-88d6-410d-9964-ac2634fc67e5" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba252f04-3f01-4236-b09b-81daf2ec6cdd]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Lock "cinder-quobyte-64c7735e-88d6-410d-9964-ac2634fc67e5" acquired by "delete_volume" :: waited 0.041s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:48 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf" returned: 0 in 0.472s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18160ac-d842-434e-9dd7-ee3cd58267c9]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-64c7735e-88d6-410d-9964-ac2634fc67e5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:48 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf Jul 31 10:56:48 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:48 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 Jul 31 10:56:48 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:48 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-64c7735e-88d6-410d-9964-ac2634fc67e5 Jul 31 10:56:48 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:48 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-00014096-e26c-4c06-b7aa-996fa7f55ddf" returned: 0 in 0.411s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "cinder-quobyte-00014096-e26c-4c06-b7aa-996fa7f55ddf" released by "delete_volume" :: held 0.944s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:48 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823" returned: 0 in 0.573s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:48 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Created reservations ['5700df6e-9138-41e7-9e6a-607b93b7ea8a', '51713f91-3a37-481c-9f6f-8b8e514ec512', '3e5aa9bb-e43f-4cc9-8f2a-2e78a7f470d8', 'b96e2df3-060c-422c-856b-73ea98cf9b41'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:48 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 1G Jul 31 10:56:48 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:49 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-64c7735e-88d6-410d-9964-ac2634fc67e5" returned: 0 in 0.590s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-64c7735e-88d6-410d-9964-ac2634fc67e5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:49 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-64c7735e-88d6-410d-9964-ac2634fc67e5 Jul 31 10:56:49 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:49 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:56:49 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:49 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-64c7735e-88d6-410d-9964-ac2634fc67e5" returned: 0 in 0.382s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Lock "cinder-quobyte-64c7735e-88d6-410d-9964-ac2634fc67e5" released by "delete_volume" :: held 1.041s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:49 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.357s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:49 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 1G" returned: 0 in 0.551s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a7d5cab-b464-4ff0-8d13-7207af599823 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:49 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Deleted volume successfully. Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ef3a2958-fd49-492e-9730-5bff6944ed09 tempest-AttachVolumeNegativeTest-1174809077 None] Lock "cinder-00014096-e26c-4c06-b7aa-996fa7f55ddf-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:49 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a7d5cab-b464-4ff0-8d13-7207af599823 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 Jul 31 10:56:49 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Created reservations ['1be137ac-90f2-4627-ba9d-e8ab7a7d03cf'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:49 devstack cinder-volume[89145]: WARNING cinder.quota [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1399652323 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1399652323, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:56:49 devstack cinder-volume[89145]: WARNING cinder.quota [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1399652323 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1399652323, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Created reservations ['6fdc71d2-d5a4-406b-a15c-96163fc43856', 'bb1e7967-67a1-461b-8c50-27ae5db46c69', 'ea6241d8-edab-4a56-8097-ac45f34fe17c', '72c99ce8-a96f-4699-9ba5-41e3d18e8329'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Created reservations ['27282b93-b8d6-41da-9c06-01280a07226b', 'f7bd2dda-ee6f-4e15-8c06-36e707170653', 'f1c2bc98-1349-435e-9dae-b3a34e741bb3', '73655472-dc8d-4c09-a29d-119ca2990e53'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:49 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a7d5cab-b464-4ff0-8d13-7207af599823 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2" returned: 0 in 0.511s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:49 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 is being set with open permissions: ugo+rw Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:50 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 Jul 31 10:56:50 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:50 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:56:50 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "cinder-5f033188-9ade-4e32-82d4-a0b7d00e6271-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Lock "cinder-5f033188-9ade-4e32-82d4-a0b7d00e6271-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "cinder-quobyte-5f033188-9ade-4e32-82d4-a0b7d00e6271" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:50 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2" returned: 0 in 0.478s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Lock "cinder-quobyte-5f033188-9ade-4e32-82d4-a0b7d00e6271" acquired by "delete_volume" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:50 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.442s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:50 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b1086d5a-1106-4632-9fdd-3c5a9a07b3d4 tempest-GroupsTest-1697400485 None] Delete group completed successfully. Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[12446204-daaf-42da-bd96-450b410a1ce9]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:50 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.info Jul 31 10:56:50 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:50 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271 Jul 31 10:56:50 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:50 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.info" returned: 0 in 0.340s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:50 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.info is being set with open permissions: ugo+rw Jul 31 10:56:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:50 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.info Jul 31 10:56:50 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:51 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271" returned: 0 in 0.538s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:51 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271 Jul 31 10:56:51 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:51 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.info" returned: 0 in 0.327s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.977s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:51 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ab875788-7fc1-4809-87c7-d32abb4d3324 tempest-VolumesSnapshotTestJSON-1268411013 None] Create snapshot completed successfully Jul 31 10:56:51 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f033188-9ade-4e32-82d4-a0b7d00e6271" returned: 0 in 0.424s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Lock "cinder-quobyte-5f033188-9ade-4e32-82d4-a0b7d00e6271" released by "delete_volume" :: held 1.030s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Created reservations ['8f9444fd-3edb-4a81-aabe-417b34e3b66d', 'a3484ff6-ada1-4776-a319-e82ab32c4909', '9feddb40-c2b9-4270-9e59-2214e3a5f064', '89ae90c6-5fbc-4f0a-bb39-acbf716aa4f6'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:51 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:56:51 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:51 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.259s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:51 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:51 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Deleted volume successfully. Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8ab4959a-899f-47c2-87f0-07e252cbd00e tempest-AttachVolumeNegativeTest-1174809077 None] Lock "cinder-5f033188-9ade-4e32-82d4-a0b7d00e6271-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Flow 'volume_create_manager' (4f1548e0-e64c-4f7a-9651-47bc744fad6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab414824-2958-4d90-8019-ec56950feb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab414824-2958-4d90-8019-ec56950feb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-486469469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483f1c1b-c594-4e14-a91a-48b1e37148b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84574e11078e45e88fa382711798ba0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=95b47bbb-f5e0-4644-9e6e-ca85d33791c2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:52Z,use_quota=True,user_id='299bd59caa27464486e6d24acb468571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860ef02f-c86b-46e2-b572-e64539a91534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860ef02f-c86b-46e2-b572-e64539a91534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7243129e-4de3-4d5a-a1dc-f2f25c6c7638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7243129e-4de3-4d5a-a1dc-f2f25c6c7638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '483f1c1b-c594-4e14-a91a-48b1e37148b7', 'volume_name': 'volume-483f1c1b-c594-4e14-a91a-48b1e37148b7', 'volume_size': 1, 'snapshot_id': '95b47bbb-f5e0-4644-9e6e-ca85d33791c2'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111094f2-e7d8-483d-a2a1-7987460cba1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111094f2-e7d8-483d-a2a1-7987460cba1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b2af86-f046-41c5-b660-fde5d4a0628c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:52 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Volume 483f1c1b-c594-4e14-a91a-48b1e37148b7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-483f1c1b-c594-4e14-a91a-48b1e37148b7', 'volume_size': 1, 'snapshot_id': '95b47bbb-f5e0-4644-9e6e-ca85d33791c2'} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-95b47bbb-f5e0-4644-9e6e-ca85d33791c2-483f1c1b-c594-4e14-a91a-48b1e37148b7" by "_create_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-95b47bbb-f5e0-4644-9e6e-ca85d33791c2-483f1c1b-c594-4e14-a91a-48b1e37148b7" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Creating volume 483f1c1b-c594-4e14-a91a-48b1e37148b7 from snapshot 95b47bbb-f5e0-4644-9e6e-ca85d33791c2 {{(pid=89145) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-483f1c1b-c594-4e14-a91a-48b1e37148b7" by "_copy_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-483f1c1b-c594-4e14-a91a-48b1e37148b7" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] snapshot: 95b47bbb-f5e0-4644-9e6e-ca85d33791c2, volume: 483f1c1b-c594-4e14-a91a-48b1e37148b7, {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f559bc-e0d3-4699-9c85-f47ba949f98a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:52 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 Jul 31 10:56:52 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "cinder-53579c1f-d88a-4e90-a7be-f6597f7ca2b6-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Lock "cinder-53579c1f-d88a-4e90-a7be-f6597f7ca2b6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:52 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2" returned: 0 in 0.483s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a7d5cab-b464-4ff0-8d13-7207af599823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Creating direct copy from snapshot {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 10:56:52 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde16064-7623-485f-9281-e8f376363951]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "cinder-quobyte-53579c1f-d88a-4e90-a7be-f6597f7ca2b6" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Lock "cinder-quobyte-53579c1f-d88a-4e90-a7be-f6597f7ca2b6" acquired by "delete_volume" :: waited 0.034s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f113ae30-158d-4845-af6b-921549004ed9]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:53 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 Jul 31 10:56:53 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:53 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6 Jul 31 10:56:53 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:53 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823" returned: 0 in 0.480s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG cinder.utils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Path /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7 not found in is_blk_device check {{(pid=89145) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:53 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7 Jul 31 10:56:53 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:53 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6" returned: 0 in 0.465s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:53 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6 Jul 31 10:56:53 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:53 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-53579c1f-d88a-4e90-a7be-f6597f7ca2b6" returned: 0 in 0.307s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Lock "cinder-quobyte-53579c1f-d88a-4e90-a7be-f6597f7ca2b6" released by "delete_volume" :: held 0.833s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:53 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Created reservations ['e40835a7-8395-4d0b-a015-845bc1c9a60b', '25a91e8c-d8a5-432b-a845-ecc50ecc2b15', '7f07429e-6dd9-41e9-a15f-5c3161135c0b', '96ff3eae-7876-4ecb-b76c-bff6580ac873'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:54 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:56:54 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:54 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.681s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:54 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:54 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Deleted volume successfully. Jul 31 10:56:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-843c9761-0d5e-4378-a6a7-8f18ee1a05de tempest-AttachVolumeNegativeTest-1174809077 None] Lock "cinder-53579c1f-d88a-4e90-a7be-f6597f7ca2b6-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:59 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7" returned: 0 in 6.054s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:59 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ab9428-c1cd-426d-9e32-c902ef956d0f]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:59 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 Jul 31 10:56:59 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:00 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823" returned: 0 in 0.565s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7 {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:57:00 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Converted 1024.00 MB image at 169.06 MB/s Jul 31 10:57:00 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7 is being set with open permissions: ugo+rw Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:00 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7 Jul 31 10:57:00 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:00 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7" returned: 0 in 0.333s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-483f1c1b-c594-4e14-a91a-48b1e37148b7" released by "_copy_volume_from_snapshot" :: held 8.048s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-95b47bbb-f5e0-4644-9e6e-ca85d33791c2-483f1c1b-c594-4e14-a91a-48b1e37148b7" released by "_create_volume_from_snapshot" :: held 8.084s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.105s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=132,cinder:UPDATE=128,cinder:DELETE=9,cinder:INSERT=37 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=144,cinder:SELECT=128,cinder:INSERT=26,cinder:DELETE=10 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b2af86-f046-41c5-b660-fde5d4a0628c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483f1c1b-c594-4e14-a91a-48b1e37148b7', 'volume_size': 1, 'snapshot_id': '95b47bbb-f5e0-4644-9e6e-ca85d33791c2'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f2aaf5-3b86-4cc2-a0b9-6d58717cef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:00 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Volume volume-483f1c1b-c594-4e14-a91a-48b1e37148b7 (483f1c1b-c594-4e14-a91a-48b1e37148b7): created successfully Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f2aaf5-3b86-4cc2-a0b9-6d58717cef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Flow 'volume_create_manager' (4f1548e0-e64c-4f7a-9651-47bc744fad6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:00 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ef76caa1-3258-4a47-9b9e-d3f431e0781b tempest-VolumesSnapshotTestJSON-1268411013 None] Created volume successfully. Jul 31 10:57:01 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2f0bac21-3d0c-442b-9522-68e002d8de3f tempest-GroupsV314Test-959744686 None] Group tempest-GroupsV314Test-Group-1433129304: creating Jul 31 10:57:01 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2f0bac21-3d0c-442b-9522-68e002d8de3f tempest-GroupsV314Test-959744686 None] Group tempest-GroupsV314Test-Group-1433129304: created successfully Jul 31 10:57:01 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2f0bac21-3d0c-442b-9522-68e002d8de3f tempest-GroupsV314Test-959744686 None] Create group completed successfully. Jul 31 10:57:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-483f1c1b-c594-4e14-a91a-48b1e37148b7-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-483f1c1b-c594-4e14-a91a-48b1e37148b7-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-483f1c1b-c594-4e14-a91a-48b1e37148b7" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-483f1c1b-c594-4e14-a91a-48b1e37148b7" acquired by "delete_volume" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:01 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bffc61-e258-4d1c-89a0-c9a2a7a6fb82]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:01 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7 Jul 31 10:57:01 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:02 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7" returned: 0 in 0.480s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:02 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7 Jul 31 10:57:02 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:02 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-483f1c1b-c594-4e14-a91a-48b1e37148b7" returned: 0 in 0.440s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-483f1c1b-c594-4e14-a91a-48b1e37148b7" released by "delete_volume" :: held 1.000s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:02 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Created reservations ['5fa9afb3-6a4b-4287-8911-c961479f48c1', 'd745a359-f3a6-4d3b-87c2-65df042e50b0', '5b8f531b-a284-491e-93da-bacfc7a3fec0', 'b8b4d739-cfec-46ae-99da-987db8efd94b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:02 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:02 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Flow 'volume_create_manager' (1b855860-6ebe-4944-a532-f5ae4ae89ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f6f3d1-5473-43b6-8b06-d56ca4ef4649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f6f3d1-5473-43b6-8b06-d56ca4ef4649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2118474844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=324b26a0-3edc-466f-b256-63bef88a66d0,host='devstack@QuobyteHD#QuobyteHD',id=05edbc4f-36a5-486c-8761-167ac1f3231d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2318c019f39945d1a304f66c16088252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:03Z,use_quota=True,user_id='9e8ebd3508a543e6847bea3a15bf5be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cb0f6b5-2f5a-4647-a84a-b24df87778ac),volume_type_id=9cb0f6b5-2f5a-4647-a84a-b24df87778ac)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f45a692f-69ba-4a2d-9ce4-4bded0b7ebf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f45a692f-69ba-4a2d-9ce4-4bded0b7ebf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e32e0e-bcd4-4736-afad-b41153691f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e32e0e-bcd4-4736-afad-b41153691f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05edbc4f-36a5-486c-8761-167ac1f3231d', 'volume_name': 'volume-05edbc4f-36a5-486c-8761-167ac1f3231d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36adeb8f-370e-4fa0-9254-83e4e31dc464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36adeb8f-370e-4fa0-9254-83e4e31dc464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0f921c-c671-4698-93de-651019bfc9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:03 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Volume 05edbc4f-36a5-486c-8761-167ac1f3231d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05edbc4f-36a5-486c-8761-167ac1f3231d', 'volume_size': 1} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=324b26a0-3edc-466f-b256-63bef88a66d0,created_at=2026-07-31T08:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2118474844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=324b26a0-3edc-466f-b256-63bef88a66d0,host='devstack@QuobyteHD#QuobyteHD',id=05edbc4f-36a5-486c-8761-167ac1f3231d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2318c019f39945d1a304f66c16088252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:03Z,use_quota=True,user_id='9e8ebd3508a543e6847bea3a15bf5be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cb0f6b5-2f5a-4647-a84a-b24df87778ac),volume_type_id=9cb0f6b5-2f5a-4647-a84a-b24df87778ac)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Creating volume 05edbc4f-36a5-486c-8761-167ac1f3231d {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:03 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:03 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d 1073741824 Jul 31 10:57:03 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:03 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.489s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:03 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Deleted volume successfully. Jul 31 10:57:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3afad3f-a1ac-4007-a48e-00fcac4b7b37 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-483f1c1b-c594-4e14-a91a-48b1e37148b7-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-95b47bbb-f5e0-4644-9e6e-ca85d33791c2-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:04 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d 1073741824" returned: 0 in 0.708s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-95b47bbb-f5e0-4644-9e6e-ca85d33791c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-5a7d5cab-b464-4ff0-8d13-7207af599823" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-5a7d5cab-b464-4ff0-8d13-7207af599823" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-95b47bbb-f5e0-4644-9e6e-ca85d33791c2" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-95b47bbb-f5e0-4644-9e6e-ca85d33791c2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Deleting offline snapshot 95b47bbb-f5e0-4644-9e6e-ca85d33791c2 of volume 5a7d5cab-b464-4ff0-8d13-7207af599823 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] snapshot_file for this snap is: volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1aba0b-8c1d-412d-a8d1-16a259708bdb]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:04 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d Jul 31 10:57:04 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:04 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 Jul 31 10:57:04 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:04 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d" returned: 0 in 0.330s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0f921c-c671-4698-93de-651019bfc9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05edbc4f-36a5-486c-8761-167ac1f3231d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f287bb-d1d3-41d5-9807-1cacb7a5fb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:04 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Volume volume-05edbc4f-36a5-486c-8761-167ac1f3231d (05edbc4f-36a5-486c-8761-167ac1f3231d): created successfully Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f287bb-d1d3-41d5-9807-1cacb7a5fb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Flow 'volume_create_manager' (1b855860-6ebe-4944-a532-f5ae4ae89ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:04 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-245ba39f-6f80-4fee-8a59-e5775364f5c1 tempest-GroupsV314Test-959744686 None] Created volume successfully. Jul 31 10:57:04 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2" returned: 0 in 0.615s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a7d5cab-b464-4ff0-8d13-7207af599823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[083b6e46-89fe-49f7-99dc-7f36e8631390]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:04 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 Jul 31 10:57:04 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:05 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823" returned: 0 in 0.393s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:05 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 Jul 31 10:57:05 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:05 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2" returned: 0 in 0.413s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:05 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2 Jul 31 10:57:05 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:05 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823.95b47bbb-f5e0-4644-9e6e-ca85d33791c2" returned: 0 in 0.269s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:05 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-95b47bbb-f5e0-4644-9e6e-ca85d33791c2" released by "_delete_snapshot" :: held 1.839s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:05 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-5a7d5cab-b464-4ff0-8d13-7207af599823" released by "delete_snapshot" :: held 1.871s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Created reservations ['27ef11dd-2ef1-4a4c-b5f9-35e020006755', '0d6c1488-bd54-4623-96ae-523f8cb01636', '843e7eb4-81aa-481d-8954-4c427fbeb311', 'ef8c2288-3235-4eed-a3e8-62d48557c256'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:06 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Delete snapshot completed successfully. Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4fa2cfdd-b128-49ee-992b-25d6e8985998 tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-95b47bbb-f5e0-4644-9e6e-ca85d33791c2-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:06 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Cloning volume 05edbc4f-36a5-486c-8761-167ac1f3231d to volume 70fec640-9aab-4060-b591-878732fff22b Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Creating offline snapshot d30637eb-ee1c-4d0c-a1cd-f8305b16b074 of volume 05edbc4f-36a5-486c-8761-167ac1f3231d {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1beb8d-bad8-42ce-bdc7-6f65e84a8f7c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Flow 'volume_create_manager' (704079db-06d5-4cf8-b685-2205174d2ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ad491f-bc56-4a25-9672-8efd42740b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:06 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d Jul 31 10:57:06 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ad491f-bc56-4a25-9672-8efd42740b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-421956464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c733347e790547008b1e61ba94bfa0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:07Z,use_quota=True,user_id='ca5565f816f942308d0159c7499e7b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3effb652-5c11-46d3-8c79-57b106b0d7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3effb652-5c11-46d3-8c79-57b106b0d7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f014be50-10dd-4d3f-ac0a-71d5182ceacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f014be50-10dd-4d3f-ac0a-71d5182ceacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0', 'volume_name': 'volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc39d2a-e400-4aab-8a72-79351f9b04ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc39d2a-e400-4aab-8a72-79351f9b04ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d614cc8-68cd-41cc-9ba1-39b0b226408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:06 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Volume 8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0', 'volume_size': 1} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-5a7d5cab-b464-4ff0-8d13-7207af599823-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-5a7d5cab-b464-4ff0-8d13-7207af599823-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-5a7d5cab-b464-4ff0-8d13-7207af599823" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-5a7d5cab-b464-4ff0-8d13-7207af599823" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[90da3d6a-5d7c-4460-b986-6bc43a2f9791]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:07 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d" returned: 0 in 0.616s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:07 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 1G Jul 31 10:57:07 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:07 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 Jul 31 10:57:07 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:07 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823" returned: 0 in 0.396s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:07 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823 Jul 31 10:57:07 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:07 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 1G" returned: 0 in 0.481s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05edbc4f-36a5-486c-8761-167ac1f3231d -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:07 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05edbc4f-36a5-486c-8761-167ac1f3231d -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 Jul 31 10:57:07 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:07 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a7d5cab-b464-4ff0-8d13-7207af599823" returned: 0 in 0.285s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-5a7d5cab-b464-4ff0-8d13-7207af599823" released by "delete_volume" :: held 0.770s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Created reservations ['9049351b-2ea4-431e-a652-a9a2505c412a', '75864f55-4f19-496a-96b2-ee671638078d', '6d8a9d10-9d82-4d9e-8d57-ae6619e49467', '3393f825-801f-47d1-a5bd-db5ccfc11f86'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:07 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:07 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:07 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05edbc4f-36a5-486c-8761-167ac1f3231d -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074" returned: 0 in 0.363s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:07 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:57:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:07 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 Jul 31 10:57:07 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:08 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.264s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:08 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Deleted volume successfully. Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-3427be9b-4dea-4a88-a6ec-e24b5647d987-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3cd499c-40a5-422c-8a5b-8f7911c4851f tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-5a7d5cab-b464-4ff0-8d13-7207af599823-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-3427be9b-4dea-4a88-a6ec-e24b5647d987-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:08 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:08 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "cinder-quobyte-3427be9b-4dea-4a88-a6ec-e24b5647d987" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:08 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074" returned: 0 in 0.388s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-3427be9b-4dea-4a88-a6ec-e24b5647d987" acquired by "delete_volume" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[27398199-2f20-4740-aafc-471a7ad9b512]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:08 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.info Jul 31 10:57:08 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:08 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 Jul 31 10:57:08 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:08 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.339s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:57:08 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.info" returned: 0 in 0.327s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:08 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:57:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:08 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.info Jul 31 10:57:08 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:09 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987" returned: 0 in 0.637s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:09 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987 Jul 31 10:57:09 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:09 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.info" returned: 0 in 0.366s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Acquiring lock "cinder-quobyte-70fec640-9aab-4060-b591-878732fff22b" by "_copy_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Lock "cinder-quobyte-70fec640-9aab-4060-b591-878732fff22b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] snapshot: d30637eb-ee1c-4d0c-a1cd-f8305b16b074, volume: 70fec640-9aab-4060-b591-878732fff22b, {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2a1036-9bfd-4eaa-acc4-41c42157faea]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:09 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 Jul 31 10:57:09 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:09 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3427be9b-4dea-4a88-a6ec-e24b5647d987" returned: 0 in 0.267s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-quobyte-3427be9b-4dea-4a88-a6ec-e24b5647d987" released by "delete_volume" :: held 1.011s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Created reservations ['ffd69e47-8910-4138-acf4-a4357cfc1cfd', '3a391625-f832-4940-a950-bff45a3c1558', '211ec3c9-e580-4427-8ff5-e987c2c95e1b', 'e185afa2-ed8d-4c44-8486-d8e8fe157c8a'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:09 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:09 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:09 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074" returned: 0 in 0.454s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05edbc4f-36a5-486c-8761-167ac1f3231d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Creating direct copy from snapshot {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6400a42-d6a8-4e57-b26a-3ef65298c2e2]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:09 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d Jul 31 10:57:09 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:09 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.267s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:09 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Deleted volume successfully. Jul 31 10:57:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-49a60140-f2dd-408a-b27f-d69d6af917be tempest-VolumesSnapshotTestJSON-1268411013 None] Lock "cinder-3427be9b-4dea-4a88-a6ec-e24b5647d987-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:10 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d" returned: 0 in 0.426s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:10 devstack cinder-volume[89145]: DEBUG cinder.utils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Path /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b not found in is_blk_device check {{(pid=89145) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:57:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:10 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b Jul 31 10:57:10 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:15 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b" returned: 0 in 5.846s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:15 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8ce92c-22b5-4ede-b35e-c05ed05fa1da]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:16 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d Jul 31 10:57:16 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:16 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d" returned: 0 in 0.547s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:16 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:57:16 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Converted 1024.00 MB image at 175.09 MB/s Jul 31 10:57:16 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:57:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:16 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b Jul 31 10:57:16 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:16 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b" returned: 0 in 0.268s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Lock "cinder-quobyte-70fec640-9aab-4060-b591-878732fff22b" released by "_copy_volume_from_snapshot" :: held 7.645s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Acquiring lock "cinder-quobyte-d30637eb-ee1c-4d0c-a1cd-f8305b16b074" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Lock "cinder-quobyte-d30637eb-ee1c-4d0c-a1cd-f8305b16b074" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Deleting offline snapshot d30637eb-ee1c-4d0c-a1cd-f8305b16b074 of volume 05edbc4f-36a5-486c-8761-167ac1f3231d {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:57:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] snapshot_file for this snap is: volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:57:16 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[726ead76-d93c-4b03-96c7-d5c7395725ce]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:16 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 Jul 31 10:57:16 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:17 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074" returned: 0 in 0.523s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05edbc4f-36a5-486c-8761-167ac1f3231d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:17 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c9a959-e372-4749-baee-70ab6a6fc7e2]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:17 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d Jul 31 10:57:17 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:17 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d" returned: 0 in 0.509s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:17 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 Jul 31 10:57:17 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:18 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074" returned: 0 in 0.773s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:18 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074 Jul 31 10:57:18 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:19 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d.d30637eb-ee1c-4d0c-a1cd-f8305b16b074" returned: 0 in 0.447s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Lock "cinder-quobyte-d30637eb-ee1c-4d0c-a1cd-f8305b16b074" released by "_delete_snapshot" :: held 2.396s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.858s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.428s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-421956464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c733347e790547008b1e61ba94bfa0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:07Z,use_quota=True,user_id='ca5565f816f942308d0159c7499e7b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Creating volume 8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:19 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:57:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:19 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0 1073741824 Jul 31 10:57:19 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:19 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-25e4dae9-c609-4529-b577-22c698d55b85 tempest-GroupsV314Test-959744686 None] Create group from source-group-324b26a0-3edc-466f-b256-63bef88a66d0 completed successfully. Jul 31 10:57:20 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0 1073741824" returned: 0 in 0.918s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:20 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0 Jul 31 10:57:20 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:20 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0" returned: 0 in 0.363s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d614cc8-68cd-41cc-9ba1-39b0b226408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880e5ef2-35ba-48d0-809b-b0766dc6e252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:20 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Volume volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0 (8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0): created successfully Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880e5ef2-35ba-48d0-809b-b0766dc6e252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Flow 'volume_create_manager' (704079db-06d5-4cf8-b685-2205174d2ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:20 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-1dca5a63-01aa-4f72-beda-8483c7b03440 req-e8e3c127-d18d-456b-a122-4a17635a2026 tempest-VolumesGetTestJSON-455739295 None] Created volume successfully. Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Acquiring lock "cinder-quobyte-70fec640-9aab-4060-b591-878732fff22b" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Lock "cinder-quobyte-70fec640-9aab-4060-b591-878732fff22b" acquired by "delete_volume" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfba73e-d195-4a55-b390-9bd96562eb3c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:20 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b Jul 31 10:57:20 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:21 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b" returned: 0 in 0.512s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:21 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b Jul 31 10:57:21 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:21 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-70fec640-9aab-4060-b591-878732fff22b" returned: 0 in 0.475s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Lock "cinder-quobyte-70fec640-9aab-4060-b591-878732fff22b" released by "delete_volume" :: held 1.066s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:21 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Created reservations ['95d9a298-106b-4c6f-8a8e-002550a5a3ed'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:21 devstack cinder-volume[89145]: WARNING cinder.quota [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2052947632 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2052947632, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:21 devstack cinder-volume[89145]: WARNING cinder.quota [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2052947632 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2052947632, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Created reservations ['9202047e-87dd-49db-9be0-3efe872f4bce', 'bd5dff68-11cc-4e2f-b9ed-a106c7cf5d13', 'c0f99bfb-a8e8-4631-9813-872e0ff694b6', 'eb51b523-5bed-478b-be0c-9e08fa4185cb'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Acquiring lock "cinder-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Lock "cinder-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Acquiring lock "cinder-quobyte-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Lock "cinder-quobyte-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0" acquired by "delete_volume" :: waited 0.045s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ee7a55-d7b9-4212-8671-a8bd50d97b7c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:22 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:22 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:22 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0 Jul 31 10:57:22 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:22 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.353s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:22 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-aae89734-aa2f-40a2-8861-a48e3536dc42 tempest-GroupsV314Test-959744686 None] Delete group completed successfully. Jul 31 10:57:22 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0" returned: 0 in 0.566s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:22 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0 Jul 31 10:57:22 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Flow 'volume_create_manager' (7a5db284-65a8-4e20-951d-974bbe03e0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b877ab2-23b1-49c5-ab74-7f3f25748d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b877ab2-23b1-49c5-ab74-7f3f25748d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1839139369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2e2681-3f3a-4627-8a13-7233f4b3668f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e7d1632cc94d048fcedefe84c05b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:23Z,use_quota=True,user_id='4b3b09ee62604161abe661962b14d69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c17594-fc65-4c21-bb00-fae501b6736c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c17594-fc65-4c21-bb00-fae501b6736c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6ea222-3e47-4181-9e32-346e1cb7066f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6ea222-3e47-4181-9e32-346e1cb7066f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2e2681-3f3a-4627-8a13-7233f4b3668f', 'volume_name': 'volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e4474e-aa4a-441f-b1c0-daa59a63e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e4474e-aa4a-441f-b1c0-daa59a63e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc86704e-133b-4dcd-a58d-012788c61789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:22 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Volume 5a2e2681-3f3a-4627-8a13-7233f4b3668f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f', 'volume_size': 1} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1839139369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2e2681-3f3a-4627-8a13-7233f4b3668f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e7d1632cc94d048fcedefe84c05b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:23Z,use_quota=True,user_id='4b3b09ee62604161abe661962b14d69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Creating volume 5a2e2681-3f3a-4627-8a13-7233f4b3668f {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:22 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:57:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:23 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f 1073741824 Jul 31 10:57:23 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:23 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0" returned: 0 in 0.361s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Lock "cinder-quobyte-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0" released by "delete_volume" :: held 1.012s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG cinder.quota [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Created reservations ['e4e1afa0-3392-46e1-996e-aed4fe391342', 'c9ad3029-c45f-450d-9333-4eabaa8e0217', '43d94938-57de-498a-b5df-3c4763a28042', '60a0b02d-d2ea-40e3-a32d-44269472e36b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:23 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:23 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:23 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f 1073741824" returned: 0 in 0.838s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Acquiring lock "cinder-quobyte-05edbc4f-36a5-486c-8761-167ac1f3231d" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:23 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.467s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG cinder.manager [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:23 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Deleted volume successfully. Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Lock "cinder-quobyte-05edbc4f-36a5-486c-8761-167ac1f3231d" acquired by "delete_volume" :: waited 0.066s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[176a47e8-d9bd-4dd4-81fa-aa5d4f38779f]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-b151a6ec-9e70-46ea-818b-210fc9905379 req-33fa0896-af8e-4528-ab3d-9dcf71dff6f2 tempest-VolumesGetTestJSON-455739295 None] Lock "cinder-8f115eed-6c57-45d4-83ea-8bbdcdd6b4d0-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:24 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f Jul 31 10:57:24 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:24 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d Jul 31 10:57:24 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:24 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d" returned: 0 in 0.536s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:24 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f" returned: 0 in 0.530s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:24 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d Jul 31 10:57:24 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc86704e-133b-4dcd-a58d-012788c61789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5788d5-43c1-4649-919f-64c9de8423f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:24 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Volume volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f (5a2e2681-3f3a-4627-8a13-7233f4b3668f): created successfully Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5788d5-43c1-4649-919f-64c9de8423f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Flow 'volume_create_manager' (7a5db284-65a8-4e20-951d-974bbe03e0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:24 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-546662b8-c03a-456b-829f-2fde579d18cf tempest-VolumesSnapshotListTestJSON-1717186792 None] Created volume successfully. Jul 31 10:57:24 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-05edbc4f-36a5-486c-8761-167ac1f3231d" returned: 0 in 0.402s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Lock "cinder-quobyte-05edbc4f-36a5-486c-8761-167ac1f3231d" released by "delete_volume" :: held 1.066s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Created reservations ['6c5c4afe-6fd1-4832-843d-5f3bbd4f3712'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Created reservations ['7637bfdf-3878-48bd-952d-f8a426eb3956', '011b0852-97c4-42f2-85cc-d500f5bd4512', '13c1e498-0d68-4ae7-9a38-383b8cc411f4', 'd5948db9-a25b-4c0c-a838-d1a95a8d0c94'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:25 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:25 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] Creating offline snapshot 0e8b1666-1728-4f66-ab3d-af827ffca02b of volume 5a2e2681-3f3a-4627-8a13-7233f4b3668f {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c3eb48-9480-4fb6-a6ae-c4adacdbda07]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:25 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f Jul 31 10:57:25 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:26 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.519s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:26 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:26 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3d6ab726-c0ac-4d87-822c-7e41653639d3 tempest-GroupsV314Test-959744686 None] Delete group completed successfully. Jul 31 10:57:26 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f" returned: 0 in 0.611s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:26 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b 1G Jul 31 10:57:26 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:26 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b 1G" returned: 0 in 0.727s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:26 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b Jul 31 10:57:26 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:27 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b" returned: 0 in 0.457s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:27 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b is being set with open permissions: ugo+rw Jul 31 10:57:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:27 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b Jul 31 10:57:27 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:27 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b" returned: 0 in 0.455s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:27 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.info Jul 31 10:57:27 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:28 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.info" returned: 0 in 0.447s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:28 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.info is being set with open permissions: ugo+rw Jul 31 10:57:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:28 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.info Jul 31 10:57:28 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:28 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.info" returned: 0 in 0.395s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.259s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:28 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-dc5f3671-b964-4c84-83f9-5da64a28c86a tempest-VolumesSnapshotListTestJSON-1717186792 None] Create snapshot completed successfully Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] Creating offline snapshot 6c381273-d655-409c-8de9-60c3a5f0fdb8 of volume 5a2e2681-3f3a-4627-8a13-7233f4b3668f {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0e9619-f825-4b87-ba51-f5c3c463705e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:30 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b Jul 31 10:57:30 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Flow 'volume_create_manager' (d70404d2-2082-4c30-aff5-3f50a1aaf284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7f2f2e-c8f3-49b7-ab49-b9d8602b60e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7f2f2e-c8f3-49b7-ab49-b9d8602b60e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1086077710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3efef7d83bd64bab9e92a0c1839ea76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:31Z,use_quota=True,user_id='bf8799f1c8f94fb29fa9cc118ae86a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5e99e3-5e74-44c9-b5ec-bb9d181e6229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5e99e3-5e74-44c9-b5ec-bb9d181e6229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6a4d07-1881-46ab-8300-fadd4a0989e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6a4d07-1881-46ab-8300-fadd4a0989e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c', 'volume_name': 'volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1023cee6-45cb-4c25-91bd-2285ad640378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1023cee6-45cb-4c25-91bd-2285ad640378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aec873f-e049-418d-b00c-01859aed37cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:30 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Volume 8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c', 'volume_size': 1} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:30 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b" returned: 0 in 0.549s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:30 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 1G Jul 31 10:57:30 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:31 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 1G" returned: 0 in 0.484s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:31 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 Jul 31 10:57:31 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:31 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8" returned: 0 in 0.340s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:31 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 is being set with open permissions: ugo+rw Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:31 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 Jul 31 10:57:31 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:31 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8" returned: 0 in 0.271s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.772s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.155s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1086077710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3efef7d83bd64bab9e92a0c1839ea76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:31Z,use_quota=True,user_id='bf8799f1c8f94fb29fa9cc118ae86a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Creating volume 8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:31 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:57:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:31 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c 1073741824 Jul 31 10:57:31 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:31 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-bb86200c-4f7d-478f-9e83-0f567965e410 tempest-VolumesSnapshotListTestJSON-1717186792 None] Create snapshot completed successfully Jul 31 10:57:32 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c 1073741824" returned: 0 in 0.587s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:32 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c Jul 31 10:57:32 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:32 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c" returned: 0 in 0.268s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.297s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aec873f-e049-418d-b00c-01859aed37cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c366c887-2ec8-4a16-b26a-48d6b5c659a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] Creating offline snapshot 6eefd5f1-027b-4690-815e-92c604b990c5 of volume 5a2e2681-3f3a-4627-8a13-7233f4b3668f {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:57:32 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Volume volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c (8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c): created successfully Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c366c887-2ec8-4a16-b26a-48d6b5c659a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Flow 'volume_create_manager' (d70404d2-2082-4c30-aff5-3f50a1aaf284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[82477564-58ea-4832-af67-2ff06b9064d7]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:32 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-80bb6128-ea54-43c6-8c1b-9af236895468 tempest-VolumesTestJSON-1309003459 None] Created volume successfully. Jul 31 10:57:33 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 Jul 31 10:57:33 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:33 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8" returned: 0 in 0.403s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:33 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 1G Jul 31 10:57:33 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:33 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 1G" returned: 0 in 0.578s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:33 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 Jul 31 10:57:33 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:34 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5" returned: 0 in 0.486s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:34 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 is being set with open permissions: ugo+rw Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:34 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 Jul 31 10:57:34 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Flow 'volume_create_manager' (5c208c9b-426e-43ab-baf4-e6d3a2ca41d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8503d405-568c-43b9-99ed-6021937f9a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8503d405-568c-43b9-99ed-6021937f9a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1462233643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3541df62-b1b9-4421-bd03-ee240540ac7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3efef7d83bd64bab9e92a0c1839ea76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:34Z,use_quota=True,user_id='bf8799f1c8f94fb29fa9cc118ae86a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6451b1e7-87dc-4c44-b456-c6bcd05b6128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6451b1e7-87dc-4c44-b456-c6bcd05b6128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6391419f-51c9-4256-93bd-0107a1f79922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6391419f-51c9-4256-93bd-0107a1f79922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3541df62-b1b9-4421-bd03-ee240540ac7f', 'volume_name': 'volume-3541df62-b1b9-4421-bd03-ee240540ac7f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497f1dd8-2bf2-493f-9cc6-d6989745a7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497f1dd8-2bf2-493f-9cc6-d6989745a7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4185fd06-afb8-472b-9340-e185622046eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:34 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Volume 3541df62-b1b9-4421-bd03-ee240540ac7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3541df62-b1b9-4421-bd03-ee240540ac7f', 'volume_size': 1} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:34 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5" returned: 0 in 0.298s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.120s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1462233643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3541df62-b1b9-4421-bd03-ee240540ac7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3efef7d83bd64bab9e92a0c1839ea76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:34Z,use_quota=True,user_id='bf8799f1c8f94fb29fa9cc118ae86a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Creating volume 3541df62-b1b9-4421-bd03-ee240540ac7f {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:34 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:57:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3541df62-b1b9-4421-bd03-ee240540ac7f 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:34 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3541df62-b1b9-4421-bd03-ee240540ac7f 1073741824 Jul 31 10:57:34 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:34 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c9cf426f-3ad1-4f55-abd8-22bc364fd768 tempest-VolumesSnapshotListTestJSON-1717186792 None] Create snapshot completed successfully Jul 31 10:57:35 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3541df62-b1b9-4421-bd03-ee240540ac7f 1073741824" returned: 0 in 0.457s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3541df62-b1b9-4421-bd03-ee240540ac7f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:35 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3541df62-b1b9-4421-bd03-ee240540ac7f Jul 31 10:57:35 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Flow 'volume_create_manager' (becf7178-15d3-46ac-86d3-e3d21c4ae9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed887831-d14e-4357-adec-6d2c131c0bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:35 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3541df62-b1b9-4421-bd03-ee240540ac7f" returned: 0 in 0.279s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed887831-d14e-4357-adec-6d2c131c0bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1320685843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41041545-b764-476a-aaaa-e86e768713be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69ce8ae82a46eba1d63b4d6f5e4558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:35Z,use_quota=True,user_id='20ed04e794fe4518a78bd7be9ba4c29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640c486a-5a6e-4ce4-b6dc-cbe595b4a89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640c486a-5a6e-4ce4-b6dc-cbe595b4a89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9517d0-197e-4ce9-80ec-8830bec94c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9517d0-197e-4ce9-80ec-8830bec94c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41041545-b764-476a-aaaa-e86e768713be', 'volume_name': 'volume-41041545-b764-476a-aaaa-e86e768713be', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a53360-9b67-4f44-8f93-834550c48e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a53360-9b67-4f44-8f93-834550c48e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0068ee2d-4939-45f9-ac24-e1cbac662101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:35 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Volume 41041545-b764-476a-aaaa-e86e768713be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41041545-b764-476a-aaaa-e86e768713be', 'volume_size': 1} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1320685843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41041545-b764-476a-aaaa-e86e768713be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69ce8ae82a46eba1d63b4d6f5e4558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:35Z,use_quota=True,user_id='20ed04e794fe4518a78bd7be9ba4c29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Creating volume 41041545-b764-476a-aaaa-e86e768713be {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:35 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-41041545-b764-476a-aaaa-e86e768713be 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:35 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-41041545-b764-476a-aaaa-e86e768713be 1073741824 Jul 31 10:57:35 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4185fd06-afb8-472b-9340-e185622046eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3541df62-b1b9-4421-bd03-ee240540ac7f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7996b1-b31c-4ba2-b8cb-e565624d9bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:35 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Volume volume-3541df62-b1b9-4421-bd03-ee240540ac7f (3541df62-b1b9-4421-bd03-ee240540ac7f): created successfully Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7996b1-b31c-4ba2-b8cb-e565624d9bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Flow 'volume_create_manager' (5c208c9b-426e-43ab-baf4-e6d3a2ca41d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:35 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-48141b01-d3be-4c03-9637-f74c0a7cab0f tempest-VolumesTestJSON-1309003459 None] Created volume successfully. Jul 31 10:57:36 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-41041545-b764-476a-aaaa-e86e768713be 1073741824" returned: 0 in 0.517s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-41041545-b764-476a-aaaa-e86e768713be {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:36 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-41041545-b764-476a-aaaa-e86e768713be Jul 31 10:57:36 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:36 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-41041545-b764-476a-aaaa-e86e768713be" returned: 0 in 0.343s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0068ee2d-4939-45f9-ac24-e1cbac662101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41041545-b764-476a-aaaa-e86e768713be', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd82e714-dfe9-4ef8-9d9f-943d3f166080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:36 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Volume volume-41041545-b764-476a-aaaa-e86e768713be (41041545-b764-476a-aaaa-e86e768713be): created successfully Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd82e714-dfe9-4ef8-9d9f-943d3f166080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Flow 'volume_create_manager' (becf7178-15d3-46ac-86d3-e3d21c4ae9aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:36 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7121ea15-ca26-46e6-94e3-12064e40c88f tempest-VolumeQuotasAdminTestJSON-579428104 None] Created volume successfully. Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "cinder-6eefd5f1-027b-4690-815e-92c604b990c5-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-6eefd5f1-027b-4690-815e-92c604b990c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "cinder-quobyte-5a2e2681-3f3a-4627-8a13-7233f4b3668f" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-5a2e2681-3f3a-4627-8a13-7233f4b3668f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "cinder-quobyte-6eefd5f1-027b-4690-815e-92c604b990c5" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-6eefd5f1-027b-4690-815e-92c604b990c5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Deleting offline snapshot 6eefd5f1-027b-4690-815e-92c604b990c5 of volume 5a2e2681-3f3a-4627-8a13-7233f4b3668f {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] snapshot_file for this snap is: volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8238cf-584b-4a80-87bc-e5a1cd77272d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:36 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 Jul 31 10:57:36 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:37 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Flow 'volume_create_manager' (5ba14c6f-90fe-4226-9c62-d0dd2b276a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d680ae-cc45-4243-bfde-8c14e4dfadc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5" returned: 0 in 0.463s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d680ae-cc45-4243-bfde-8c14e4dfadc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1350703021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3efef7d83bd64bab9e92a0c1839ea76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:37Z,use_quota=True,user_id='bf8799f1c8f94fb29fa9cc118ae86a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3ea74c-7a4e-4629-b129-bd75282c70a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3ea74c-7a4e-4629-b129-bd75282c70a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0f23cc-d1a9-4af2-ab59-488afa3e834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0f23cc-d1a9-4af2-ab59-488afa3e834c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53', 'volume_name': 'volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d6b334-fff2-4249-ac6d-9628a2d09ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d6b334-fff2-4249-ac6d-9628a2d09ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a323167-93c0-4ffa-84c3-c1d5250e42be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:37 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Volume a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53', 'volume_size': 1} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1350703021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3efef7d83bd64bab9e92a0c1839ea76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:37Z,use_quota=True,user_id='bf8799f1c8f94fb29fa9cc118ae86a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Creating volume a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:37 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[312c038c-1af5-4f83-83a3-a93ec17150dc]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:37 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53 1073741824 Jul 31 10:57:37 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:37 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 Jul 31 10:57:37 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:37 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Acquiring lock "cinder-41041545-b764-476a-aaaa-e86e768713be-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8" returned: 0 in 0.409s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "cinder-41041545-b764-476a-aaaa-e86e768713be-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:37 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 Jul 31 10:57:37 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Acquiring lock "cinder-quobyte-41041545-b764-476a-aaaa-e86e768713be" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "cinder-quobyte-41041545-b764-476a-aaaa-e86e768713be" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:37 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9109a85-ed8e-485e-997d-939cd8d0f0c2]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53 1073741824" returned: 0 in 0.545s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-41041545-b764-476a-aaaa-e86e768713be {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:37 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53 Jul 31 10:57:37 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:37 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-41041545-b764-476a-aaaa-e86e768713be Jul 31 10:57:37 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:38 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53" returned: 0 in 0.286s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a323167-93c0-4ffa-84c3-c1d5250e42be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc03e17-f0c1-412c-a3fe-ddade3b468d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:38 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Volume volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53 (a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53): created successfully Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc03e17-f0c1-412c-a3fe-ddade3b468d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Flow 'volume_create_manager' (5ba14c6f-90fe-4226-9c62-d0dd2b276a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:38 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5" returned: 0 in 0.500s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:38 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-41041545-b764-476a-aaaa-e86e768713be" returned: 0 in 0.391s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-41041545-b764-476a-aaaa-e86e768713be {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:38 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5 Jul 31 10:57:38 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-33f6ece5-4c48-42a5-b56c-a1ef94544f4d tempest-VolumesTestJSON-1309003459 None] Created volume successfully. Jul 31 10:57:38 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-41041545-b764-476a-aaaa-e86e768713be Jul 31 10:57:38 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:38 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6eefd5f1-027b-4690-815e-92c604b990c5" returned: 0 in 0.245s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:38 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-41041545-b764-476a-aaaa-e86e768713be" returned: 0 in 0.253s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-6eefd5f1-027b-4690-815e-92c604b990c5" released by "_delete_snapshot" :: held 1.775s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "cinder-quobyte-41041545-b764-476a-aaaa-e86e768713be" released by "delete_volume" :: held 0.701s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-5a2e2681-3f3a-4627-8a13-7233f4b3668f" released by "delete_snapshot" :: held 1.799s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Created reservations ['66091cc0-7560-44c7-a566-1ad9c3ded769', 'dc1f84b9-13af-40e1-8e92-c7bb7ba87f9a', '6f22f790-588f-4bb9-96ae-7b993fbded4c', '798614d4-9500-4999-a21f-7e540ffd9a0d'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Created reservations ['bf88a97d-6289-4432-bf3f-a3c32916d05c', 'a169eb0f-057c-4670-819b-6c655511acd7', 'd34b574a-55d0-4ca6-bd1c-d6580266673d', 'a18ef98d-5d2c-4fba-bb3f-83c8d0b71059'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Delete snapshot completed successfully. Jul 31 10:57:38 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:38 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22450aef-d14c-489c-82a6-8429bfac647d tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-6eefd5f1-027b-4690-815e-92c604b990c5-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "cinder-6c381273-d655-409c-8de9-60c3a5f0fdb8-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-6c381273-d655-409c-8de9-60c3a5f0fdb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "cinder-quobyte-5a2e2681-3f3a-4627-8a13-7233f4b3668f" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-5a2e2681-3f3a-4627-8a13-7233f4b3668f" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "cinder-quobyte-6c381273-d655-409c-8de9-60c3a5f0fdb8" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-6c381273-d655-409c-8de9-60c3a5f0fdb8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Deleting offline snapshot 6c381273-d655-409c-8de9-60c3a5f0fdb8 of volume 5a2e2681-3f3a-4627-8a13-7233f4b3668f {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] snapshot_file for this snap is: volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2874be42-d0ee-4ba2-b822-a50e2876323e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:38 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.328s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Deleted volume successfully. Jul 31 10:57:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-29bb9db0-516b-470b-9103-35a2ba0d1b6f tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "cinder-41041545-b764-476a-aaaa-e86e768713be-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:38 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 Jul 31 10:57:38 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:39 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8" returned: 0 in 0.433s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabd6804-58e6-4d6b-8c78-fe47091edd9e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Flow 'volume_create_manager' (d773ef31-8bdb-4c6e-ab12-4e9563bfe77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72d1108-e9b8-4e5e-8dc9-16469006461c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72d1108-e9b8-4e5e-8dc9-16469006461c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1475299283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b6d275-a582-4122-85d0-84c15c24b81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69ce8ae82a46eba1d63b4d6f5e4558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:39Z,use_quota=True,user_id='20ed04e794fe4518a78bd7be9ba4c29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9010fd0a-1d30-443f-9667-17260a7237ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9010fd0a-1d30-443f-9667-17260a7237ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46314e81-60d4-41b4-bc28-66e1f5d6a089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46314e81-60d4-41b4-bc28-66e1f5d6a089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b6d275-a582-4122-85d0-84c15c24b81d', 'volume_name': 'volume-66b6d275-a582-4122-85d0-84c15c24b81d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:39 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b Jul 31 10:57:39 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c8e5cc-665d-4275-8c55-e15eba78d650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c8e5cc-665d-4275-8c55-e15eba78d650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536626c2-0b2b-4889-bf8c-bb309516d625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:39 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Volume 66b6d275-a582-4122-85d0-84c15c24b81d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b6d275-a582-4122-85d0-84c15c24b81d', 'volume_size': 1} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1475299283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b6d275-a582-4122-85d0-84c15c24b81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69ce8ae82a46eba1d63b4d6f5e4558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:39Z,use_quota=True,user_id='20ed04e794fe4518a78bd7be9ba4c29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Creating volume 66b6d275-a582-4122-85d0-84c15c24b81d {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:39 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-66b6d275-a582-4122-85d0-84c15c24b81d 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:39 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-66b6d275-a582-4122-85d0-84c15c24b81d 1073741824 Jul 31 10:57:39 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:39 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b" returned: 0 in 0.500s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:39 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 Jul 31 10:57:39 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:40 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-66b6d275-a582-4122-85d0-84c15c24b81d 1073741824" returned: 0 in 0.629s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-66b6d275-a582-4122-85d0-84c15c24b81d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:40 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-66b6d275-a582-4122-85d0-84c15c24b81d Jul 31 10:57:40 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:40 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8" returned: 0 in 0.507s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Acquiring lock "cinder-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:40 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8 Jul 31 10:57:40 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Lock "cinder-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Acquiring lock "cinder-quobyte-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Lock "cinder-quobyte-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53" acquired by "delete_volume" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:40 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-66b6d275-a582-4122-85d0-84c15c24b81d" returned: 0 in 0.339s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b970477-31da-491f-8011-7e40a64445aa]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536626c2-0b2b-4889-bf8c-bb309516d625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b6d275-a582-4122-85d0-84c15c24b81d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e775cba-ee3d-4b41-b8bd-ab40cd88099c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:40 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Volume volume-66b6d275-a582-4122-85d0-84c15c24b81d (66b6d275-a582-4122-85d0-84c15c24b81d): created successfully Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e775cba-ee3d-4b41-b8bd-ab40cd88099c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Flow 'volume_create_manager' (d773ef31-8bdb-4c6e-ab12-4e9563bfe77b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:40 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a1026de8-4f8f-4473-8109-f4b3ad96b3b2 tempest-VolumeQuotasAdminTestJSON-579428104 None] Created volume successfully. Jul 31 10:57:40 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53 Jul 31 10:57:40 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:40 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.6c381273-d655-409c-8de9-60c3a5f0fdb8" returned: 0 in 0.312s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-6c381273-d655-409c-8de9-60c3a5f0fdb8" released by "_delete_snapshot" :: held 1.878s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-5a2e2681-3f3a-4627-8a13-7233f4b3668f" released by "delete_snapshot" :: held 1.902s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Created reservations ['77b56e51-435b-474a-8ddf-5c36317cfc18', '16c664c8-bc3d-437d-933f-bfb030d6084f', '1e1d9dca-705f-42d6-b039-a75f491daa31', '65aab6ea-d1de-48ae-b175-db9dc9ad1820'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:40 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Delete snapshot completed successfully. Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-90a6b418-18d4-4e3b-857e-e569421bda6d tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-6c381273-d655-409c-8de9-60c3a5f0fdb8-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "cinder-0e8b1666-1728-4f66-ab3d-af827ffca02b-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-0e8b1666-1728-4f66-ab3d-af827ffca02b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "cinder-quobyte-5a2e2681-3f3a-4627-8a13-7233f4b3668f" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:40 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53" returned: 0 in 0.470s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-5a2e2681-3f3a-4627-8a13-7233f4b3668f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "cinder-quobyte-0e8b1666-1728-4f66-ab3d-af827ffca02b" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:40 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53 Jul 31 10:57:41 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-0e8b1666-1728-4f66-ab3d-af827ffca02b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Deleting offline snapshot 0e8b1666-1728-4f66-ab3d-af827ffca02b of volume 5a2e2681-3f3a-4627-8a13-7233f4b3668f {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] snapshot_file for this snap is: volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b509e011-ef7b-4028-afb5-97cba561d223]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:41 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b Jul 31 10:57:41 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:41 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53" returned: 0 in 0.276s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Lock "cinder-quobyte-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53" released by "delete_volume" :: held 0.790s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Created reservations ['6a90d446-86ef-42f9-aff1-4b23aab17a16', '8907c338-be88-4deb-bbb8-cf283f43bc9f', 'ea96678a-3ea2-4ae0-84f4-a2711fa88e47', 'c38c74c0-2ecf-4787-9234-ced1058cb275'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:41 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:41 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:41 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b" returned: 0 in 0.496s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Acquiring lock "cinder-3541df62-b1b9-4421-bd03-ee240540ac7f-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db1d54f-414e-4b89-af25-f490e7638b58]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Lock "cinder-3541df62-b1b9-4421-bd03-ee240540ac7f-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Acquiring lock "cinder-quobyte-3541df62-b1b9-4421-bd03-ee240540ac7f" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Lock "cinder-quobyte-3541df62-b1b9-4421-bd03-ee240540ac7f" acquired by "delete_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:41 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.394s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:41 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Deleted volume successfully. Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa01d7d7-92db-4bd3-8fa2-d8a29e63101d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3541df62-b1b9-4421-bd03-ee240540ac7f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fc7c6172-e24a-41c1-bfd2-83006a1a193f tempest-VolumesTestJSON-1309003459 None] Lock "cinder-a9bbd4e4-9eb6-4e8a-909b-5f1e4c00ad53-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:41 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f Jul 31 10:57:41 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:41 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3541df62-b1b9-4421-bd03-ee240540ac7f Jul 31 10:57:41 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:42 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f" returned: 0 in 0.564s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:42 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b Jul 31 10:57:42 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:42 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3541df62-b1b9-4421-bd03-ee240540ac7f" returned: 0 in 0.466s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3541df62-b1b9-4421-bd03-ee240540ac7f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:42 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3541df62-b1b9-4421-bd03-ee240540ac7f Jul 31 10:57:42 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-63643a3a-9a1d-4779-b7c4-176c711881b6 tempest-VolumeQuotasAdminTestJSON-665597114 None] Transfer volume completed successfully. Jul 31 10:57:42 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3541df62-b1b9-4421-bd03-ee240540ac7f" returned: 0 in 0.335s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Lock "cinder-quobyte-3541df62-b1b9-4421-bd03-ee240540ac7f" released by "delete_volume" :: held 0.873s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:42 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b" returned: 0 in 0.482s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:42 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b Jul 31 10:57:42 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Created reservations ['d56d0540-31d3-4dff-a8f6-22fe6e81a3a4', 'c93d9095-2dae-4a9c-aa60-c293001b182c', '2675516b-d3f0-4138-817f-71771798eb9b', '3cbfe159-1267-465a-8010-d58248f9622c'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:43 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:43 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:43 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f.0e8b1666-1728-4f66-ab3d-af827ffca02b" returned: 0 in 0.383s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Acquiring lock "cinder-66b6d275-a582-4122-85d0-84c15c24b81d-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-0e8b1666-1728-4f66-ab3d-af827ffca02b" released by "_delete_snapshot" :: held 2.150s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-5a2e2681-3f3a-4627-8a13-7233f4b3668f" released by "delete_snapshot" :: held 2.181s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Lock "cinder-66b6d275-a582-4122-85d0-84c15c24b81d-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Acquiring lock "cinder-quobyte-66b6d275-a582-4122-85d0-84c15c24b81d" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Lock "cinder-quobyte-66b6d275-a582-4122-85d0-84c15c24b81d" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Created reservations ['66b753c8-dd25-4b15-982a-8941a1d556e6', '673501ba-0808-4228-a96f-094501199594', 'a9fdbe3c-3f34-4b76-af93-32ed5627149d', '36bd61eb-39b5-417d-8587-b3af83f690e3'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aa17c8-4488-4b27-a83c-80e1d58d18b9]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-66b6d275-a582-4122-85d0-84c15c24b81d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:43 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.320s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:43 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Deleted volume successfully. Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5ea5a456-2e7a-4571-b8b2-abd5eb7e7c48 tempest-VolumesTestJSON-1309003459 None] Lock "cinder-3541df62-b1b9-4421-bd03-ee240540ac7f-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:43 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Delete snapshot completed successfully. Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cf6974e5-4fec-4798-9cb3-ea48788e8811 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-0e8b1666-1728-4f66-ab3d-af827ffca02b-delete_snapshot" released by "delete_snapshot" :: held 2.427s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:43 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-66b6d275-a582-4122-85d0-84c15c24b81d Jul 31 10:57:43 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:43 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-66b6d275-a582-4122-85d0-84c15c24b81d" returned: 0 in 0.382s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-66b6d275-a582-4122-85d0-84c15c24b81d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:43 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-66b6d275-a582-4122-85d0-84c15c24b81d Jul 31 10:57:43 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Acquiring lock "cinder-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Lock "cinder-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:43 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-66b6d275-a582-4122-85d0-84c15c24b81d" returned: 0 in 0.262s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Lock "cinder-quobyte-66b6d275-a582-4122-85d0-84c15c24b81d" released by "delete_volume" :: held 0.702s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Acquiring lock "cinder-quobyte-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Lock "cinder-quobyte-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c" acquired by "delete_volume" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee29b219-4fee-4c0d-93ee-ef4f513e08e2]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Created reservations ['90d86bee-d2f4-40c4-a19c-57500ec2672a', 'fcac8287-08bf-49e5-948d-3e0a829514c7', 'bc96b43f-4d50-4195-9de0-4ff939140374', 'f9e63e69-c715-4f43-bcf0-0f4b852a12f1'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:44 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c Jul 31 10:57:44 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:44 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:44 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "cinder-5a2e2681-3f3a-4627-8a13-7233f4b3668f-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-5a2e2681-3f3a-4627-8a13-7233f4b3668f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "cinder-quobyte-5a2e2681-3f3a-4627-8a13-7233f4b3668f" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-5a2e2681-3f3a-4627-8a13-7233f4b3668f" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9841ac90-8c8a-40fb-849d-554f0f44ed58]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:44 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.356s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:44 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Deleted volume successfully. Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-a2f8d893-2d21-4f14-9398-1b4ac375e8e2 tempest-VolumeQuotasAdminTestJSON-166226900 None] Lock "cinder-66b6d275-a582-4122-85d0-84c15c24b81d-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:44 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c" returned: 0 in 0.511s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:44 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c Jul 31 10:57:44 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:44 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f Jul 31 10:57:44 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:44 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c" returned: 0 in 0.270s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Lock "cinder-quobyte-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c" released by "delete_volume" :: held 0.832s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Created reservations ['aea96d86-9dfd-4721-b6c5-17b6c626e571', '1cb98459-b56d-457f-9d09-8e255683145e', 'bd5b3f04-3619-4e32-90ee-298d61acdb9b', '140e17c3-6db1-4241-8a69-222cbff7c5d9'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:44 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f" returned: 0 in 0.514s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:45 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f Jul 31 10:57:45 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:45 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:45 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:45 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5a2e2681-3f3a-4627-8a13-7233f4b3668f" returned: 0 in 0.333s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-quobyte-5a2e2681-3f3a-4627-8a13-7233f4b3668f" released by "delete_volume" :: held 0.935s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Created reservations ['66957433-53b0-4d72-beda-e3cd0f2b20c0', '09008fb3-0f17-467a-aa57-97db068f817e', '158cd83a-ce1e-42b0-add5-2a0d823471ca', '347a87e1-2808-4ee1-9e77-365c68e792c4'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:45 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.437s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Deleted volume successfully. Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f9a21bc2-59f2-4637-8f64-dd7ead87741d tempest-VolumesTestJSON-1309003459 None] Lock "cinder-8b5c3fb0-460a-4920-89d9-1d81cfeb7e7c-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:45 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:45 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Flow 'volume_create_manager' (9ca04354-52d4-44bf-8b4b-82e1ed15de1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5143b3e7-55c5-4bc8-9426-eb3639722333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5143b3e7-55c5-4bc8-9426-eb3639722333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-597197991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290e12e2-60fe-421e-bfc0-34ce883d030b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9545a61afa4e77917acf93522aa43b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:46Z,use_quota=True,user_id='ff13a410e6e34033a903c66251c59bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8135fb93-aa45-4cdd-b71c-8b20f4abc61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8135fb93-aa45-4cdd-b71c-8b20f4abc61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d969f7b-33ee-4667-9da5-8891ac3718f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d969f7b-33ee-4667-9da5-8891ac3718f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '290e12e2-60fe-421e-bfc0-34ce883d030b', 'volume_name': 'volume-290e12e2-60fe-421e-bfc0-34ce883d030b', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2905da-0fae-4b77-b850-4d6d3d054767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2905da-0fae-4b77-b850-4d6d3d054767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082c54d2-ce57-4cce-8b7e-5b1e99fdc792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:45 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Volume 290e12e2-60fe-421e-bfc0-34ce883d030b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-290e12e2-60fe-421e-bfc0-34ce883d030b', 'volume_size': 1} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-597197991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290e12e2-60fe-421e-bfc0-34ce883d030b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9545a61afa4e77917acf93522aa43b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:46Z,use_quota=True,user_id='ff13a410e6e34033a903c66251c59bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Creating volume 290e12e2-60fe-421e-bfc0-34ce883d030b {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:45 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:57:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:46 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.369s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:46 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:46 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b 1073741824 Jul 31 10:57:46 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Deleted volume successfully. Jul 31 10:57:46 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9f7d315d-c3da-401d-9b29-0393f5f19963 tempest-VolumesSnapshotListTestJSON-1717186792 None] Lock "cinder-5a2e2681-3f3a-4627-8a13-7233f4b3668f-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:46 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b 1073741824" returned: 0 in 0.513s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:46 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b Jul 31 10:57:46 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:46 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b" returned: 0 in 0.419s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082c54d2-ce57-4cce-8b7e-5b1e99fdc792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-290e12e2-60fe-421e-bfc0-34ce883d030b', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e41c41-d787-4fa2-8081-a66d1a88ddbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:47 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Volume volume-290e12e2-60fe-421e-bfc0-34ce883d030b (290e12e2-60fe-421e-bfc0-34ce883d030b): created successfully Jul 31 10:57:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e41c41-d787-4fa2-8081-a66d1a88ddbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Flow 'volume_create_manager' (9ca04354-52d4-44bf-8b4b-82e1ed15de1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:47 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7c955a78-dda5-40ef-ba4a-2c1f1a62f177 tempest-AttachVolumeTestJSON-760762861 None] Created volume successfully. Jul 31 10:57:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-ea28b32b-b7af-4b40-8842-416e93873d9c req-e3fd4ca9-cac4-4cef-bd13-a986b32f5395 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-ea28b32b-b7af-4b40-8842-416e93873d9c req-e3fd4ca9-cac4-4cef-bd13-a986b32f5395 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:49 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb193e13-7bd6-492b-880e-145ce7926b3c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-ea28b32b-b7af-4b40-8842-416e93873d9c req-e3fd4ca9-cac4-4cef-bd13-a986b32f5395 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:49 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b Jul 31 10:57:49 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:49 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-ea28b32b-b7af-4b40-8842-416e93873d9c req-e3fd4ca9-cac4-4cef-bd13-a986b32f5395 tempest-AttachVolumeTestJSON-760762861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b" returned: 0 in 0.508s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-ea28b32b-b7af-4b40-8842-416e93873d9c req-e3fd4ca9-cac4-4cef-bd13-a986b32f5395 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.541s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-ea28b32b-b7af-4b40-8842-416e93873d9c req-e3fd4ca9-cac4-4cef-bd13-a986b32f5395 tempest-AttachVolumeTestJSON-760762861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-290e12e2-60fe-421e-bfc0-34ce883d030b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9c1e554-181a-4179-8ba5-6f6e90afe79a', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:57:49 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-ea28b32b-b7af-4b40-8842-416e93873d9c req-e3fd4ca9-cac4-4cef-bd13-a986b32f5395 tempest-AttachVolumeTestJSON-760762861 None] attachment_update completed successfully. Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Flow 'volume_create_manager' (5ec3ee52-2b8a-490b-8b64-08ebdfe38e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89000f1-1bb2-46a4-ba56-47d55986aeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89000f1-1bb2-46a4-ba56-47d55986aeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1341560844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d54ce7f-4bbb-4bce-852e-81a394cd6979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9545a61afa4e77917acf93522aa43b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:53Z,use_quota=True,user_id='ff13a410e6e34033a903c66251c59bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ff3e08-ce36-4e7e-ab88-1b2569886173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ff3e08-ce36-4e7e-ab88-1b2569886173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6150e1-84bb-4dcf-ac88-3532aec94fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6150e1-84bb-4dcf-ac88-3532aec94fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d54ce7f-4bbb-4bce-852e-81a394cd6979', 'volume_name': 'volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d57847-e1bf-4581-b510-06ee2882581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d57847-e1bf-4581-b510-06ee2882581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642ffeaf-eb10-4934-a081-289be5939403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:53 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Volume 8d54ce7f-4bbb-4bce-852e-81a394cd6979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979', 'volume_size': 1} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1341560844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d54ce7f-4bbb-4bce-852e-81a394cd6979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9545a61afa4e77917acf93522aa43b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:53Z,use_quota=True,user_id='ff13a410e6e34033a903c66251c59bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Creating volume 8d54ce7f-4bbb-4bce-852e-81a394cd6979 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:53 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:53 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979 1073741824 Jul 31 10:57:53 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:53 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979 1073741824" returned: 0 in 0.644s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:53 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979 Jul 31 10:57:53 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:54 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979" returned: 0 in 0.339s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642ffeaf-eb10-4934-a081-289be5939403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81faf6c4-0081-493f-be02-7e7f46acd33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:54 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Volume volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979 (8d54ce7f-4bbb-4bce-852e-81a394cd6979): created successfully Jul 31 10:57:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81faf6c4-0081-493f-be02-7e7f46acd33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Flow 'volume_create_manager' (5ec3ee52-2b8a-490b-8b64-08ebdfe38e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:54 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9ff8f558-04b5-4458-84ad-81ebdc08ab38 tempest-AttachVolumeTestJSON-760762861 None] Created volume successfully. Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Flow 'volume_create_manager' (a7d10c27-04db-4d7e-a431-cc637e846c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb4607b-e2d8-4669-8633-ca106afdf091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb4607b-e2d8-4669-8633-ca106afdf091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1382586431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61173278-2b13-4e5d-a59d-ff19929e97c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d13a54c6b20248febed0103f399fa969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:55Z,use_quota=True,user_id='7c4fef52d05f4faab4233f1b0ad795bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5729c01e-0c73-47f8-9b9d-10f1dd6b299d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5729c01e-0c73-47f8-9b9d-10f1dd6b299d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809b5a5b-daf4-4e8e-a420-41ff3ed03104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809b5a5b-daf4-4e8e-a420-41ff3ed03104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61173278-2b13-4e5d-a59d-ff19929e97c7', 'volume_name': 'volume-61173278-2b13-4e5d-a59d-ff19929e97c7', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da83d43-bda1-4fb8-a0a5-9ecf10254d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da83d43-bda1-4fb8-a0a5-9ecf10254d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e70424-42df-401c-83e3-c78d9eee55ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:55 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Volume 61173278-2b13-4e5d-a59d-ff19929e97c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61173278-2b13-4e5d-a59d-ff19929e97c7', 'volume_size': 1} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1382586431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61173278-2b13-4e5d-a59d-ff19929e97c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d13a54c6b20248febed0103f399fa969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:55Z,use_quota=True,user_id='7c4fef52d05f4faab4233f1b0ad795bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Creating volume 61173278-2b13-4e5d-a59d-ff19929e97c7 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:55 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:57:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-61173278-2b13-4e5d-a59d-ff19929e97c7 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:55 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-61173278-2b13-4e5d-a59d-ff19929e97c7 1073741824 Jul 31 10:57:55 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:56 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-61173278-2b13-4e5d-a59d-ff19929e97c7 1073741824" returned: 0 in 0.619s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-f464ef5d-5eb9-43bb-8971-1278c68f3d9a req-0b729192-ae63-4a16-b05a-98e8fdfae7c8 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-61173278-2b13-4e5d-a59d-ff19929e97c7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:56 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-61173278-2b13-4e5d-a59d-ff19929e97c7 Jul 31 10:57:56 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:56 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-61173278-2b13-4e5d-a59d-ff19929e97c7" returned: 0 in 0.352s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-f464ef5d-5eb9-43bb-8971-1278c68f3d9a req-0b729192-ae63-4a16-b05a-98e8fdfae7c8 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.377s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e70424-42df-401c-83e3-c78d9eee55ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61173278-2b13-4e5d-a59d-ff19929e97c7', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e91582-7c92-4215-877a-1b9d6df88eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[16332226-2e11-4bac-8003-5bc3d053e8cd]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-f464ef5d-5eb9-43bb-8971-1278c68f3d9a req-0b729192-ae63-4a16-b05a-98e8fdfae7c8 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:56 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Volume volume-61173278-2b13-4e5d-a59d-ff19929e97c7 (61173278-2b13-4e5d-a59d-ff19929e97c7): created successfully Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e91582-7c92-4215-877a-1b9d6df88eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Flow 'volume_create_manager' (a7d10c27-04db-4d7e-a431-cc637e846c7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:56 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-493ce123-b98d-41c5-be5b-7784b355614c tempest-VolumesServicesTestJSON-2097715729 None] Created volume successfully. Jul 31 10:57:56 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979 Jul 31 10:57:56 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:57 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-f464ef5d-5eb9-43bb-8971-1278c68f3d9a req-0b729192-ae63-4a16-b05a-98e8fdfae7c8 tempest-AttachVolumeTestJSON-760762861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979" returned: 0 in 0.476s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-f464ef5d-5eb9-43bb-8971-1278c68f3d9a req-0b729192-ae63-4a16-b05a-98e8fdfae7c8 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.531s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-f464ef5d-5eb9-43bb-8971-1278c68f3d9a req-0b729192-ae63-4a16-b05a-98e8fdfae7c8 tempest-AttachVolumeTestJSON-760762861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e819ad4-22a3-490f-bbfb-105969612604', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:57:57 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-f464ef5d-5eb9-43bb-8971-1278c68f3d9a req-0b729192-ae63-4a16-b05a-98e8fdfae7c8 tempest-AttachVolumeTestJSON-760762861 None] attachment_update completed successfully. Jul 31 10:57:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Acquiring lock "cinder-61173278-2b13-4e5d-a59d-ff19929e97c7-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Lock "cinder-61173278-2b13-4e5d-a59d-ff19929e97c7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Acquiring lock "cinder-quobyte-61173278-2b13-4e5d-a59d-ff19929e97c7" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Lock "cinder-quobyte-61173278-2b13-4e5d-a59d-ff19929e97c7" acquired by "delete_volume" :: waited 0.033s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:57 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5aac1b-374a-4338-a0ca-bef404a87a21]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-61173278-2b13-4e5d-a59d-ff19929e97c7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:58 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-61173278-2b13-4e5d-a59d-ff19929e97c7 Jul 31 10:57:58 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:58 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-61173278-2b13-4e5d-a59d-ff19929e97c7" returned: 0 in 0.619s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-61173278-2b13-4e5d-a59d-ff19929e97c7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:58 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-61173278-2b13-4e5d-a59d-ff19929e97c7 Jul 31 10:57:58 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:58 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-61173278-2b13-4e5d-a59d-ff19929e97c7" returned: 0 in 0.333s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Lock "cinder-quobyte-61173278-2b13-4e5d-a59d-ff19929e97c7" released by "delete_volume" :: held 1.030s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:58 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Created reservations ['b1523060-551a-4c68-b770-fb0f6ca176a8', 'e55ccba1-14b1-4b5c-85e1-a4ca266cd06d', '96c61eca-ef45-46f7-94a5-c8b70fce8da7', '27cd7043-2a05-40f2-bb56-a33358bb1197'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:59 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:57:59 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:59 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.280s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:59 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:59 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Deleted volume successfully. Jul 31 10:57:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1281e361-c44c-47a6-a99d-bb2d3fed4f3e tempest-VolumesServicesTestJSON-2097715729 None] Lock "cinder-61173278-2b13-4e5d-a59d-ff19929e97c7-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:00 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=134,cinder:UPDATE=188,cinder:INSERT=37,cinder:DELETE=10 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:58:00 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=166,cinder:DELETE=16,cinder:SELECT=153,cinder:INSERT=47 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:58:00 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-47e5cf79-dba0-4276-9633-cb9dbcefb656 req-c842a78c-24b5-4f07-9752-a2ca46b7beb3 tempest-AttachVolumeTestJSON-760762861 None] Terminate volume connection completed successfully. Jul 31 10:58:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-47e5cf79-dba0-4276-9633-cb9dbcefb656 req-c842a78c-24b5-4f07-9752-a2ca46b7beb3 tempest-AttachVolumeTestJSON-760762861 None] Deleting attachment b9c1e554-181a-4179-8ba5-6f6e90afe79a. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:58:02 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-a59259dc-970d-4ca2-9631-9ccec013255c req-28c6cdd4-7d4b-4298-a935-d803efe39c8e tempest-AttachVolumeTestJSON-760762861 None] Terminate volume connection completed successfully. Jul 31 10:58:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-a59259dc-970d-4ca2-9631-9ccec013255c req-28c6cdd4-7d4b-4298-a935-d803efe39c8e tempest-AttachVolumeTestJSON-760762861 None] Deleting attachment 3e819ad4-22a3-490f-bbfb-105969612604. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:58:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:58:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:08 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:58:08 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:08 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.296s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:58:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:58:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:58:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "cinder-8d54ce7f-4bbb-4bce-852e-81a394cd6979-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Lock "cinder-8d54ce7f-4bbb-4bce-852e-81a394cd6979-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "cinder-quobyte-8d54ce7f-4bbb-4bce-852e-81a394cd6979" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Lock "cinder-quobyte-8d54ce7f-4bbb-4bce-852e-81a394cd6979" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:09 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa76588-8fae-4e06-a7e0-f0f33f7ac086]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:09 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979 Jul 31 10:58:09 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:10 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979" returned: 0 in 0.558s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:10 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979 Jul 31 10:58:10 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:10 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8d54ce7f-4bbb-4bce-852e-81a394cd6979" returned: 0 in 0.366s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Lock "cinder-quobyte-8d54ce7f-4bbb-4bce-852e-81a394cd6979" released by "delete_volume" :: held 1.027s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:10 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Created reservations ['d71bb1e0-98db-4cae-8421-7f2264bf4b7e', '0eaf4eba-8f87-4f9b-81f1-3869f5eef993', 'e5588bb1-7f8f-41c3-a976-dc02522ffd25', '8a9774ed-8652-4cdd-9a72-47ed680c236c'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:11 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:58:11 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:11 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.350s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:11 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:11 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Deleted volume successfully. Jul 31 10:58:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d4c576be-3190-4b4f-b849-3ce4810331e3 tempest-AttachVolumeTestJSON-760762861 None] Lock "cinder-8d54ce7f-4bbb-4bce-852e-81a394cd6979-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "cinder-290e12e2-60fe-421e-bfc0-34ce883d030b-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Lock "cinder-290e12e2-60fe-421e-bfc0-34ce883d030b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "cinder-quobyte-290e12e2-60fe-421e-bfc0-34ce883d030b" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Lock "cinder-quobyte-290e12e2-60fe-421e-bfc0-34ce883d030b" acquired by "delete_volume" :: waited 0.044s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Flow 'volume_create_manager' (3f4b65fd-dcab-4856-8016-f40eaff8b9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecb404d-4f3b-4fdc-b161-515cf02c4130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29d76ee-c0fa-4ce2-a55d-2d156d3ec6fc]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecb404d-4f3b-4fdc-b161-515cf02c4130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1010120462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f13237c-6b09-4b59-88dd-b023b66e6663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f665d1c46b40a49cb82ad50c56d48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:12Z,use_quota=True,user_id='f7f2c9c97dfc43059f2eeec070984917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ee84a7-5500-41bc-a99f-3a7585dcbeb1),volume_type_id=94ee84a7-5500-41bc-a99f-3a7585dcbeb1)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a02f5b0-0922-42a3-a286-c94ec1a11eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a02f5b0-0922-42a3-a286-c94ec1a11eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b5fc39-feaa-4c1a-995a-601a8d5fa672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b5fc39-feaa-4c1a-995a-601a8d5fa672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f13237c-6b09-4b59-88dd-b023b66e6663', 'volume_name': 'volume-3f13237c-6b09-4b59-88dd-b023b66e6663', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7a6b2d-d340-429b-b21a-d4d25679d8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7a6b2d-d340-429b-b21a-d4d25679d8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5b2ce1-82ec-4340-86b3-d0e6ff6af29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:12 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Volume 3f13237c-6b09-4b59-88dd-b023b66e6663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f13237c-6b09-4b59-88dd-b023b66e6663', 'volume_size': 1} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1010120462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f13237c-6b09-4b59-88dd-b023b66e6663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f665d1c46b40a49cb82ad50c56d48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:12Z,use_quota=True,user_id='f7f2c9c97dfc43059f2eeec070984917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ee84a7-5500-41bc-a99f-3a7585dcbeb1),volume_type_id=94ee84a7-5500-41bc-a99f-3a7585dcbeb1)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Creating volume 3f13237c-6b09-4b59-88dd-b023b66e6663 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:12 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f13237c-6b09-4b59-88dd-b023b66e6663 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:12 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f13237c-6b09-4b59-88dd-b023b66e6663 1073741824 Jul 31 10:58:12 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:12 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b Jul 31 10:58:12 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:12 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b" returned: 0 in 0.527s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:12 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b Jul 31 10:58:12 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:12 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f13237c-6b09-4b59-88dd-b023b66e6663 1073741824" returned: 0 in 0.585s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f13237c-6b09-4b59-88dd-b023b66e6663 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:12 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f13237c-6b09-4b59-88dd-b023b66e6663 Jul 31 10:58:12 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:13 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-290e12e2-60fe-421e-bfc0-34ce883d030b" returned: 0 in 0.353s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Lock "cinder-quobyte-290e12e2-60fe-421e-bfc0-34ce883d030b" released by "delete_volume" :: held 1.001s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Created reservations ['c0cd6a86-c491-449a-a4fd-18e345abab31', 'e6672b07-8fda-4a4e-a05f-12dde3eb02ed', 'f5fc4c4e-e907-4992-8247-9caadc1f1699', '05253bfc-596e-4031-98ac-acbbf7b08ea1'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:13 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f13237c-6b09-4b59-88dd-b023b66e6663" returned: 0 in 0.361s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5b2ce1-82ec-4340-86b3-d0e6ff6af29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f13237c-6b09-4b59-88dd-b023b66e6663', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:13 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ada17a-19ab-489f-919d-6a32daf075d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:13 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:13 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Volume volume-3f13237c-6b09-4b59-88dd-b023b66e6663 (3f13237c-6b09-4b59-88dd-b023b66e6663): created successfully Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ada17a-19ab-489f-919d-6a32daf075d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Flow 'volume_create_manager' (3f4b65fd-dcab-4856-8016-f40eaff8b9bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:13 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-927f7bb7-b9ca-4344-9fd9-fa07043a0992 tempest-VolumeTypesAccessTest-1780622645 None] Created volume successfully. Jul 31 10:58:13 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.280s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:13 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Deleted volume successfully. Jul 31 10:58:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3f46049b-7ff2-4d72-9d5b-90ae4a964b41 tempest-AttachVolumeTestJSON-760762861 None] Lock "cinder-290e12e2-60fe-421e-bfc0-34ce883d030b-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Acquiring lock "cinder-3f13237c-6b09-4b59-88dd-b023b66e6663-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Lock "cinder-3f13237c-6b09-4b59-88dd-b023b66e6663-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Acquiring lock "cinder-quobyte-3f13237c-6b09-4b59-88dd-b023b66e6663" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Lock "cinder-quobyte-3f13237c-6b09-4b59-88dd-b023b66e6663" acquired by "delete_volume" :: waited 0.035s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c4dd15-99b5-4860-9610-4935db801751]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f13237c-6b09-4b59-88dd-b023b66e6663 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:14 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f13237c-6b09-4b59-88dd-b023b66e6663 Jul 31 10:58:14 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "cinder-e43ebcfb-a475-4cb1-a91e-2f75e473cd65-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Lock "cinder-e43ebcfb-a475-4cb1-a91e-2f75e473cd65-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "cinder-quobyte-e43ebcfb-a475-4cb1-a91e-2f75e473cd65" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Lock "cinder-quobyte-e43ebcfb-a475-4cb1-a91e-2f75e473cd65" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca93cb0-2b65-4f02-bb78-7f27f121a222]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:14 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65 Jul 31 10:58:14 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:14 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f13237c-6b09-4b59-88dd-b023b66e6663" returned: 0 in 0.500s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f13237c-6b09-4b59-88dd-b023b66e6663 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:14 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f13237c-6b09-4b59-88dd-b023b66e6663 Jul 31 10:58:14 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:15 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65" returned: 0 in 0.470s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:15 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f13237c-6b09-4b59-88dd-b023b66e6663" returned: 0 in 0.314s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:15 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65 Jul 31 10:58:15 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Lock "cinder-quobyte-3f13237c-6b09-4b59-88dd-b023b66e6663" released by "delete_volume" :: held 0.872s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:15 devstack cinder-volume[89145]: WARNING cinder.quota [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-601229667 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-601229667, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:58:15 devstack cinder-volume[89145]: WARNING cinder.quota [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-601229667 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-601229667, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Created reservations ['64db64e5-9ee0-4253-b398-c4176f5b0acb', '83fe0c2c-3867-4f27-9ccc-2b0bc7e6d45f', '7711427a-e22a-40e2-9f85-ccb185704020', '55d33329-3436-45e3-beb9-4d8ff664dbf8'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:15 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:58:15 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:15 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e43ebcfb-a475-4cb1-a91e-2f75e473cd65" returned: 0 in 0.328s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Lock "cinder-quobyte-e43ebcfb-a475-4cb1-a91e-2f75e473cd65" released by "delete_volume" :: held 0.872s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Created reservations ['e3f84a93-a173-4662-9699-974bc8650232', 'f7a2d136-eb71-4e66-b2b9-377e6654e0ec', 'fad854a1-c75a-41c6-985f-0709e01d5128', '305dec13-ebca-45d6-90c3-1fb3ffe788c5'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:15 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:58:15 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:15 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.390s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:15 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Deleted volume successfully. Jul 31 10:58:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6461445c-e3c0-4eca-a44c-d158824240c6 tempest-VolumeTypesAccessTest-1780622645 None] Lock "cinder-3f13237c-6b09-4b59-88dd-b023b66e6663-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:16 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.386s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:16 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:16 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Deleted volume successfully. Jul 31 10:58:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4a162c94-f5c5-46fc-8fc1-684fc426c484 tempest-AttachVolumeTestJSON-760762861 None] Lock "cinder-e43ebcfb-a475-4cb1-a91e-2f75e473cd65-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Flow 'volume_create_manager' (e43ecf84-6cb2-4f5a-8c26-b32b02bdbccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7da86f-bc51-4ab1-98f3-3dc05080c32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7da86f-bc51-4ab1-98f3-3dc05080c32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-597968426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3024bc32ac0f49d3bc0c0f3e51eb9ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:17Z,use_quota=True,user_id='239c0b3ad9604fcba32c58d77b496ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ab5cd3-6c34-45cc-85a3-6cae05059eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ab5cd3-6c34-45cc-85a3-6cae05059eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0c5057-8100-4b15-8a24-28e0e421b20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0c5057-8100-4b15-8a24-28e0e421b20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe', 'volume_name': 'volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4defc28c-9794-4617-9cdb-8e7207b0005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4defc28c-9794-4617-9cdb-8e7207b0005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431de83f-4895-43d8-8eb4-d590d0c0ea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:17 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Volume c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe', 'volume_size': 1} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-597968426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3024bc32ac0f49d3bc0c0f3e51eb9ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:17Z,use_quota=True,user_id='239c0b3ad9604fcba32c58d77b496ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Creating volume c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:17 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:58:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:17 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe 1073741824 Jul 31 10:58:17 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:18 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe 1073741824" returned: 0 in 0.585s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:18 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe Jul 31 10:58:18 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:18 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe" returned: 0 in 0.287s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:18 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431de83f-4895-43d8-8eb4-d590d0c0ea64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7d5415-8523-46aa-bd03-f97198e34b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:18 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Volume volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe (c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe): created successfully Jul 31 10:58:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7d5415-8523-46aa-bd03-f97198e34b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Flow 'volume_create_manager' (e43ecf84-6cb2-4f5a-8c26-b32b02bdbccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:18 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6f1e1a8e-fb4d-4039-83b0-48479cda0476 tempest-VolumeQuotasNegativeTestJSON-341415595 None] Created volume successfully. Jul 31 10:58:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Acquiring lock "cinder-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Lock "cinder-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Acquiring lock "cinder-quobyte-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Lock "cinder-quobyte-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:20 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e0994e-d619-4d1c-9111-2b6a32df1db6]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:21 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe Jul 31 10:58:21 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:21 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe" returned: 0 in 0.563s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:21 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe Jul 31 10:58:21 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:21 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe" returned: 0 in 0.438s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Lock "cinder-quobyte-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe" released by "delete_volume" :: held 1.069s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:22 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Created reservations ['84f6649e-adc9-4199-8021-f0fb6b42c1b5', '9f9134e8-4e6f-4edf-af31-749c14338a3c', 'c276f6b0-3cbd-4bd7-95e7-bd9263442310', '602a2c73-7ec5-4ed3-b801-2ede2920a3c6'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:22 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:58:22 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:22 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.313s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:22 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:22 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Deleted volume successfully. Jul 31 10:58:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9933f9e3-e021-408a-82c3-7f8cfbe7de5c tempest-VolumeQuotasNegativeTestJSON-341415595 None] Lock "cinder-c2d98a18-a4cd-4585-ba0f-dd1a2dd1ccfe-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Flow 'volume_create_manager' (057fca40-bb90-4988-a406-f66918398197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d517aff-b058-4398-b6a0-a62c3acd2134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d517aff-b058-4398-b6a0-a62c3acd2134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1626017822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1c331f-4c68-4201-b006-5a23879e1f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715f454073474562a1b1d50587038f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:27Z,use_quota=True,user_id='9066f7ec0df847bfb9db45440212ed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(979d0ce9-3111-4ead-8f1f-a257e0c53638),volume_type_id=979d0ce9-3111-4ead-8f1f-a257e0c53638)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698c1940-76df-4ab7-b40c-fbd2cc290e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698c1940-76df-4ab7-b40c-fbd2cc290e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e161ee6a-63fa-4967-be4f-245e783af276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e161ee6a-63fa-4967-be4f-245e783af276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb1c331f-4c68-4201-b006-5a23879e1f9f', 'volume_name': 'volume-eb1c331f-4c68-4201-b006-5a23879e1f9f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ef05da-56ba-4423-999a-6bf381e01b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ef05da-56ba-4423-999a-6bf381e01b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f037aec-dbd7-4665-97f7-f8697db08e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:27 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Volume eb1c331f-4c68-4201-b006-5a23879e1f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb1c331f-4c68-4201-b006-5a23879e1f9f', 'volume_size': 1} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1626017822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1c331f-4c68-4201-b006-5a23879e1f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715f454073474562a1b1d50587038f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:27Z,use_quota=True,user_id='9066f7ec0df847bfb9db45440212ed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(979d0ce9-3111-4ead-8f1f-a257e0c53638),volume_type_id=979d0ce9-3111-4ead-8f1f-a257e0c53638)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Creating volume eb1c331f-4c68-4201-b006-5a23879e1f9f {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:27 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:27 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f 1073741824 Jul 31 10:58:27 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Flow 'volume_create_manager' (20332249-ba8c-4eef-a3dc-d906765e2d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d057761-baa7-44f4-ac7b-db0434117f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d057761-baa7-44f4-ac7b-db0434117f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-167428178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b717e9f-ad3e-4ac6-aedd-787124de5126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715f454073474562a1b1d50587038f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:28Z,use_quota=True,user_id='9066f7ec0df847bfb9db45440212ed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3954da40-8517-4960-b617-fceb647c201a),volume_type_id=3954da40-8517-4960-b617-fceb647c201a)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a320d58c-01ab-432d-9af0-7deb620418ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a320d58c-01ab-432d-9af0-7deb620418ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4865963-3290-42ad-acc8-fc45d584df70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4865963-3290-42ad-acc8-fc45d584df70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b717e9f-ad3e-4ac6-aedd-787124de5126', 'volume_name': 'volume-8b717e9f-ad3e-4ac6-aedd-787124de5126', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b785ed-23f6-4958-a08a-a3e1464e89fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b785ed-23f6-4958-a08a-a3e1464e89fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f6f266-2f93-4d84-b69b-79b0234d3ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:28 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Volume 8b717e9f-ad3e-4ac6-aedd-787124de5126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b717e9f-ad3e-4ac6-aedd-787124de5126', 'volume_size': 1} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:28 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f 1073741824" returned: 0 in 0.858s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:28 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f Jul 31 10:58:28 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:28 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f" returned: 0 in 0.422s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-167428178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b717e9f-ad3e-4ac6-aedd-787124de5126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715f454073474562a1b1d50587038f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:28Z,use_quota=True,user_id='9066f7ec0df847bfb9db45440212ed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3954da40-8517-4960-b617-fceb647c201a),volume_type_id=3954da40-8517-4960-b617-fceb647c201a)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Creating volume 8b717e9f-ad3e-4ac6-aedd-787124de5126 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:28 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:28 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126 1073741824 Jul 31 10:58:28 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f037aec-dbd7-4665-97f7-f8697db08e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1c331f-4c68-4201-b006-5a23879e1f9f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b802b92-6dd5-4a67-b501-2dbe1272ddad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:29 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Volume volume-eb1c331f-4c68-4201-b006-5a23879e1f9f (eb1c331f-4c68-4201-b006-5a23879e1f9f): created successfully Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b802b92-6dd5-4a67-b501-2dbe1272ddad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Flow 'volume_create_manager' (057fca40-bb90-4988-a406-f66918398197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7347d952-88ed-47ae-80b8-e6d1479db1c2 tempest-TestInstancesWithCinderVolumes-528178718 None] Created volume successfully. Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Flow 'volume_create_manager' (11337f82-7815-42b9-a008-17f0bd9cc4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8fcf3a-70fd-40ba-a7f4-55109623bc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8fcf3a-70fd-40ba-a7f4-55109623bc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1879601752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c46cf78-2e8e-42e7-a5ce-5db691354e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715f454073474562a1b1d50587038f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:29Z,use_quota=True,user_id='9066f7ec0df847bfb9db45440212ed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56445864-c670-41ef-ae96-6d17498ea821),volume_type_id=56445864-c670-41ef-ae96-6d17498ea821)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fe5b20-470b-45b4-b00a-966c7e5c2b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fe5b20-470b-45b4-b00a-966c7e5c2b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778bd65f-cae6-4611-ab50-6a6466cb3535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.image.glance [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Creating Keystone auth plugin from conf {{(pid=89145) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:58:29 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126 1073741824" returned: 0 in 0.566s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:29 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126 Jul 31 10:58:29 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:29 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126" returned: 0 in 0.281s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f6f266-2f93-4d84-b69b-79b0234d3ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b717e9f-ad3e-4ac6-aedd-787124de5126', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a88df9-ca55-4daf-8394-816c3f5692c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:29 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Volume volume-8b717e9f-ad3e-4ac6-aedd-787124de5126 (8b717e9f-ad3e-4ac6-aedd-787124de5126): created successfully Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a88df9-ca55-4daf-8394-816c3f5692c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Flow 'volume_create_manager' (20332249-ba8c-4eef-a3dc-d906765e2d0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-fda267d3-9b56-4017-bb33-1087958e4378 tempest-TestInstancesWithCinderVolumes-528178718 None] Created volume successfully. Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778bd65f-cae6-4611-ab50-6a6466cb3535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c46cf78-2e8e-42e7-a5ce-5db691354e50', 'volume_name': 'volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50', 'volume_size': 1, 'image_id': '9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--355629908', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '715f454073474562a1b1d50587038f9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'created_at': datetime.datetime(2026, 7, 31, 8, 58, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 58, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59/file', 'properties': {}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41c1091-429b-41b3-bdd4-c088ef9b384f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41c1091-429b-41b3-bdd4-c088ef9b384f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6dc662-c078-46d8-a6c6-145c2667f2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:29 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Volume 8c46cf78-2e8e-42e7-a5ce-5db691354e50: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50', 'volume_size': 1, 'image_id': '9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--355629908', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '715f454073474562a1b1d50587038f9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'created_at': datetime.datetime(2026, 7, 31, 8, 58, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 58, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59/file', 'properties': {}}, 'image_service': } Jul 31 10:58:29 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Trying to clone 8c46cf78-2e8e-42e7-a5ce-5db691354e50 from image 9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'metadata': {}}]). {{(pid=89145) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:58:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a38e6f9e-58d3-43e9-aff6-4223bb1828c7 tempest-BackendsCapabilitiesAdminTestsJSON-1584262113 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6408653259277, 'free_capacity_gb': 1775.6408653259277, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89145) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 10:58:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a221d868-95c8-4b9e-8ae4-cd698c5891cc tempest-BackendsCapabilitiesAdminTestsJSON-1584262113 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6408653259277, 'free_capacity_gb': 1775.6408653259277, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89145) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Flow 'volume_create_manager' (ebe46547-45c5-457d-b8e6-89e9a675c8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d947f8-9d52-4b33-ab49-a621b0221248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d947f8-9d52-4b33-ab49-a621b0221248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1651205505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145daf2f-2bab-48e9-ad1a-5b11c7c38026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6593080b5c7f4a2c85af284c6e77fe14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:33Z,use_quota=True,user_id='9c56d65f76324f67b1f71754b8e4d373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8da88df3-5f54-4ff0-a569-7a1759f90cd2),volume_type_id=8da88df3-5f54-4ff0-a569-7a1759f90cd2)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86dbf9b7-cc1f-465b-9afb-ca8980aa299b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86dbf9b7-cc1f-465b-9afb-ca8980aa299b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde48c4d-23f3-4080-863e-d00c077697d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde48c4d-23f3-4080-863e-d00c077697d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '145daf2f-2bab-48e9-ad1a-5b11c7c38026', 'volume_name': 'volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2841f834-ace6-4043-82cc-455aba85e236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2841f834-ace6-4043-82cc-455aba85e236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6209b0-05bc-495b-a99e-630b96ecd0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:33 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Volume 145daf2f-2bab-48e9-ad1a-5b11c7c38026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026', 'volume_size': 1} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1651205505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145daf2f-2bab-48e9-ad1a-5b11c7c38026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6593080b5c7f4a2c85af284c6e77fe14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:33Z,use_quota=True,user_id='9c56d65f76324f67b1f71754b8e4d373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8da88df3-5f54-4ff0-a569-7a1759f90cd2),volume_type_id=8da88df3-5f54-4ff0-a569-7a1759f90cd2)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Creating volume 145daf2f-2bab-48e9-ad1a-5b11c7c38026 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:33 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:58:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:33 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026 1073741824 Jul 31 10:58:33 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:34 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026 1073741824" returned: 0 in 0.610s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:34 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026 Jul 31 10:58:34 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD, size 20.69 MB, duration 4.42 sec {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:58:34 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Image download 20.69 MB at 4.68 MB/s Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8417a3e-8cfa-4036-b4f2-03ac5bee7538]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:34 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD Jul 31 10:58:34 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:34 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026" returned: 0 in 0.322s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6209b0-05bc-495b-a99e-630b96ecd0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd70a1a-afdf-470a-a9cd-940feeb432bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:34 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Volume volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026 (145daf2f-2bab-48e9-ad1a-5b11c7c38026): created successfully Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd70a1a-afdf-470a-a9cd-940feeb432bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Flow 'volume_create_manager' (ebe46547-45c5-457d-b8e6-89e9a675c8d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:34 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d8d1c8a6-a9b0-459b-acde-9c0268b2b953 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Created volume successfully. Jul 31 10:58:34 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Temporary image 9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59 is fetched for user 9066f7ec0df847bfb9db45440212ed0a. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e006351-adfe-4259-8c5d-fb6926f78295]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:34 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD Jul 31 10:58:34 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:35 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1879601752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c46cf78-2e8e-42e7-a5ce-5db691354e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715f454073474562a1b1d50587038f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:29Z,use_quota=True,user_id='9066f7ec0df847bfb9db45440212ed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56445864-c670-41ef-ae96-6d17498ea821),volume_type_id=56445864-c670-41ef-ae96-6d17498ea821)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Creating volume 8c46cf78-2e8e-42e7-a5ce-5db691354e50 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:35 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:35 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 1073741824 Jul 31 10:58:35 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:35 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 1073741824" returned: 0 in 0.535s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:35 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 Jul 31 10:58:35 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-433d4c9f-f144-408c-a690-ac47fdf71a61 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-433d4c9f-f144-408c-a690-ac47fdf71a61 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-433d4c9f-f144-408c-a690-ac47fdf71a61 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-433d4c9f-f144-408c-a690-ac47fdf71a61 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-433d4c9f-f144-408c-a690-ac47fdf71a61 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-433d4c9f-f144-408c-a690-ac47fdf71a61 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:36 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:58:36 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:36 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50" returned: 0 in 0.352s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Attempting download of 9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'metadata': {}}])) to volume 8c46cf78-2e8e-42e7-a5ce-5db691354e50. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a25043-69cd-491a-be66-c5e36ab1b459]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_7unoautp {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:36 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-433d4c9f-f144-408c-a690-ac47fdf71a61 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.290s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-433d4c9f-f144-408c-a690-ac47fdf71a61 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:36 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-433d4c9f-f144-408c-a690-ac47fdf71a61 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Retype volume completed successfully. Jul 31 10:58:36 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_7unoautp Jul 31 10:58:36 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:36 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_7unoautp" returned: 0 in 0.380s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_7unoautp {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:36 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_7unoautp Jul 31 10:58:36 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:37 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_7unoautp" returned: 1 in 0.404s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_7unoautp' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c642a912-1214-4378-a2e2-cf076303ca16]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:37 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3130ed53-6c90-4a49-afa0-07c3f946df62 tempest-GroupSnapshotsTest-2116496244 None] Group tempest-GroupSnapshotsTest-Group-1330667716: creating Jul 31 10:58:37 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD Jul 31 10:58:37 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:37 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3130ed53-6c90-4a49-afa0-07c3f946df62 tempest-GroupSnapshotsTest-2116496244 None] Group tempest-GroupSnapshotsTest-Group-1330667716: created successfully Jul 31 10:58:37 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3130ed53-6c90-4a49-afa0-07c3f946df62 tempest-GroupSnapshotsTest-2116496244 None] Create group completed successfully. Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Acquiring lock "cinder-145daf2f-2bab-48e9-ad1a-5b11c7c38026-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Lock "cinder-145daf2f-2bab-48e9-ad1a-5b11c7c38026-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:37 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] 9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59 was qcow2, converting to raw {{(pid=89145) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Acquiring lock "cinder-quobyte-145daf2f-2bab-48e9-ad1a-5b11c7c38026" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:37 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 Jul 31 10:58:37 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Lock "cinder-quobyte-145daf2f-2bab-48e9-ad1a-5b11c7c38026" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[216f88f9-bc8c-43c2-9ec1-c3730ddca018]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:37 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026 Jul 31 10:58:37 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:37 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026" returned: 0 in 0.430s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:38 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026 Jul 31 10:58:38 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:38 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-145daf2f-2bab-48e9-ad1a-5b11c7c38026" returned: 0 in 0.327s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Lock "cinder-quobyte-145daf2f-2bab-48e9-ad1a-5b11c7c38026" released by "delete_volume" :: held 0.822s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:38 devstack cinder-volume[89145]: WARNING cinder.quota [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:58:38 devstack cinder-volume[89145]: WARNING cinder.quota [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:58:38 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Created reservations ['e1002368-69f9-448f-82c1-30a183287c31', '097ce176-5f63-4ae5-b162-d9914711d50e', '33fb1ff6-0d07-4a68-ae05-5f641ebcc6a7', '1e5facfd-83b0-418a-8212-0e88a53dd456'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:38 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:58:38 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:38 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.442s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:38 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Deleted volume successfully. Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-722bf72d-1aa5-4649-8e20-36f97f763a07 tempest-VolumeRetypeWithoutMigrationTest-280144241 None] Lock "cinder-145daf2f-2bab-48e9-ad1a-5b11c7c38026-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Flow 'volume_create_manager' (3b6ce4ba-c192-4890-88e3-5ea950e98e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71190854-ad44-4531-a057-5e6095ed6ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71190854-ad44-4531-a057-5e6095ed6ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-604654337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0bce4ea-6bb2-45b6-b6fa-f1c2edb9cb94,host='devstack@QuobyteHD#QuobyteHD',id=3f37530e-8051-49ac-89c3-337d53fe40a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb6f9dd568a4d1abc71caf0904f3138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:39Z,use_quota=True,user_id='435c53f9c16c4cf5801111dae4b77281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18573bb3-ad6d-4fc6-9046-e5f2df03d022),volume_type_id=18573bb3-ad6d-4fc6-9046-e5f2df03d022)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67313ea-4d14-4f17-bb6d-200509df6be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67313ea-4d14-4f17-bb6d-200509df6be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b5e18b-f7c7-472a-97af-f3894c28316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b5e18b-f7c7-472a-97af-f3894c28316e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f37530e-8051-49ac-89c3-337d53fe40a2', 'volume_name': 'volume-3f37530e-8051-49ac-89c3-337d53fe40a2', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62790222-20f8-4061-b681-29e6797d5b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62790222-20f8-4061-b681-29e6797d5b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5663b3a-7f03-41cf-b024-f02ee8eab276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:39 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Volume 3f37530e-8051-49ac-89c3-337d53fe40a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f37530e-8051-49ac-89c3-337d53fe40a2', 'volume_size': 1} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a0bce4ea-6bb2-45b6-b6fa-f1c2edb9cb94,created_at=2026-07-31T08:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-604654337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0bce4ea-6bb2-45b6-b6fa-f1c2edb9cb94,host='devstack@QuobyteHD#QuobyteHD',id=3f37530e-8051-49ac-89c3-337d53fe40a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb6f9dd568a4d1abc71caf0904f3138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:39Z,use_quota=True,user_id='435c53f9c16c4cf5801111dae4b77281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18573bb3-ad6d-4fc6-9046-e5f2df03d022),volume_type_id=18573bb3-ad6d-4fc6-9046-e5f2df03d022)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Creating volume 3f37530e-8051-49ac-89c3-337d53fe40a2 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:39 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:39 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 1073741824 Jul 31 10:58:39 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:39 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50" returned: 0 in 2.054s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59_e13solmtdevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:58:39 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Converted 112.00 MB image at 54.51 MB/s Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:39 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 1G Jul 31 10:58:39 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:39 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 1073741824" returned: 0 in 0.560s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:39 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 1G" returned: 0 in 0.359s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:39 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[517d9463-ed6a-4a05-a9ac-cf4144511f8e]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:39 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:40 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 Jul 31 10:58:40 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:40 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2" returned: 0 in 0.404s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5663b3a-7f03-41cf-b024-f02ee8eab276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f37530e-8051-49ac-89c3-337d53fe40a2', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dfa749-9d05-4587-9721-b36c6f00254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:40 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Volume volume-3f37530e-8051-49ac-89c3-337d53fe40a2 (3f37530e-8051-49ac-89c3-337d53fe40a2): created successfully Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dfa749-9d05-4587-9721-b36c6f00254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Flow 'volume_create_manager' (3b6ce4ba-c192-4890-88e3-5ea950e98e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:40 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-cf96cd39-8570-4ed5-b974-95575611dd9d tempest-GroupSnapshotsTest-2116496244 None] Created volume successfully. Jul 31 10:58:40 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50" returned: 0 in 0.484s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:40 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 Jul 31 10:58:40 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:40 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50" returned: 1 in 0.426s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Downloaded image 9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'metadata': {}}])) to volume 8c46cf78-2e8e-42e7-a5ce-5db691354e50 successfully. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Temporary image 9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59 for user 9066f7ec0df847bfb9db45440212ed0a is deleted. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Marking volume 8c46cf78-2e8e-42e7-a5ce-5db691354e50 as bootable. {{(pid=89145) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Copying metadata from image 9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59 to 8c46cf78-2e8e-42e7-a5ce-5db691354e50. {{(pid=89145) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Creating volume glance metadata for volume 8c46cf78-2e8e-42e7-a5ce-5db691354e50 backed by image 9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59 with: {'image_id': '9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'image_name': 'tempest-scenario-img--355629908', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89145) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 10:58:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6dc662-c078-46d8-a6c6-145c2667f2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50', 'volume_size': 1, 'image_id': '9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--355629908', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '715f454073474562a1b1d50587038f9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59', 'created_at': datetime.datetime(2026, 7, 31, 8, 58, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 58, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d360ae5-ac9f-424f-bbcc-2a47e3f5ac59/file', 'properties': {}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366dd652-8141-4781-9d34-e8d045f4ab94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:41 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Volume volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 (8c46cf78-2e8e-42e7-a5ce-5db691354e50): created successfully Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366dd652-8141-4781-9d34-e8d045f4ab94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Flow 'volume_create_manager' (11337f82-7815-42b9-a008-17f0bd9cc4df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Flow 'volume_create_manager' (cf8573b7-779f-4bbf-95a6-e2837d8a46a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b9ee53-8dfb-4671-abeb-64c8ff193f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:41 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-0d4543ed-7ee1-4025-aa5e-dad9c2bcc213 tempest-TestInstancesWithCinderVolumes-528178718 None] Created volume successfully. Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b9ee53-8dfb-4671-abeb-64c8ff193f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1301235860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e4882f-b46c-42b8-9492-15bdd85f315e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e6ca8d3b6643a48b1dfb67dbedb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:41Z,use_quota=True,user_id='6bbb5208f8b049d195e83c500f530b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3fb276-0c1b-4150-8448-67a199ce9607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3fb276-0c1b-4150-8448-67a199ce9607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87540fde-daf6-4845-9973-d485f80e91c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.image.glance [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Creating Keystone auth plugin from conf {{(pid=89145) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87540fde-daf6-4845-9973-d485f80e91c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50e4882f-b46c-42b8-9492-15bdd85f315e', 'volume_name': 'volume-50e4882f-b46c-42b8-9492-15bdd85f315e', 'volume_size': 1, 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47167fa6716a45acb0b64b020ce63fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933c2aee-8855-417c-98fb-0c194cf4a661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933c2aee-8855-417c-98fb-0c194cf4a661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64da2a6e-1a63-4291-b089-685caeda1393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:41 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Volume 50e4882f-b46c-42b8-9492-15bdd85f315e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50e4882f-b46c-42b8-9492-15bdd85f315e', 'volume_size': 1, 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47167fa6716a45acb0b64b020ce63fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Trying to clone 50e4882f-b46c-42b8-9492-15bdd85f315e from image 73b2b0b0-b476-43bf-9b0b-2363c12be17d at location (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]). {{(pid=89145) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:58:41 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] GroupSnapshot 7fe03fb2-6af3-4a21-afb6-68c6154a7df5: creating. Jul 31 10:58:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] Group snapshot 7fe03fb2-6af3-4a21-afb6-68c6154a7df5: creating. {{(pid=89145) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] Creating offline snapshot b9a2b78a-2b3f-419b-a905-8833d030c13a of volume 3f37530e-8051-49ac-89c3-337d53fe40a2 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae547d33-b037-4c1f-9387-2b1ccaed7f25]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:58:42 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Image download 20.69 MB at 20.69 MB/s Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a706f29b-1056-460d-87c6-3839440cd252]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:42 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 Jul 31 10:58:42 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:42 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD Jul 31 10:58:42 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:42 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2" returned: 0 in 0.515s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:42 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a 1G Jul 31 10:58:42 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:42 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Temporary image 73b2b0b0-b476-43bf-9b0b-2363c12be17d is fetched for user 6bbb5208f8b049d195e83c500f530b0a. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f970662-3783-417e-b563-be09808ea0ab]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:43 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD Jul 31 10:58:43 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:43 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:43 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a 1G" returned: 0 in 0.694s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f37530e-8051-49ac-89c3-337d53fe40a2 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:43 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f37530e-8051-49ac-89c3-337d53fe40a2 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a Jul 31 10:58:43 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:43 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f37530e-8051-49ac-89c3-337d53fe40a2 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a" returned: 0 in 0.344s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:43 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:58:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:43 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a Jul 31 10:58:43 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:43 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a" returned: 0 in 0.270s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:44 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.info Jul 31 10:58:44 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:44 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.info" returned: 0 in 0.421s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:44 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:44 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.info Jul 31 10:58:44 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Flow 'volume_create_manager' (8dedd68e-1823-42b7-8950-0809c1e30610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3efc950-0049-431f-a42b-b048671c9f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3efc950-0049-431f-a42b-b048671c9f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-253828314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdbcc27-8846-42df-b0a7-9d0fbd36bd65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ad8b5038fa4b3abd6cfe254a6c7669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:44Z,use_quota=True,user_id='a650642f15b44b1fb2ace6ccacdd80af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dd9bd9-ad8b-4030-97f9-62693d23eee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dd9bd9-ad8b-4030-97f9-62693d23eee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8e1345-703e-4047-bbe3-f5a02df90508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8e1345-703e-4047-bbe3-f5a02df90508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cdbcc27-8846-42df-b0a7-9d0fbd36bd65', 'volume_name': 'volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da5e629-8405-4b24-abd4-f45bb6c9c268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da5e629-8405-4b24-abd4-f45bb6c9c268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16683ad-63b8-4324-8ba8-9485f2eef362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:44 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Volume 0cdbcc27-8846-42df-b0a7-9d0fbd36bd65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65', 'volume_size': 1} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-9d07877e-4095-41de-9c9d-c3d0f9eb826a req-6a73764c-d009-4f7a-8f3e-440ab743b9df tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:44 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.info" returned: 0 in 0.273s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.702s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.401s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1301235860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e4882f-b46c-42b8-9492-15bdd85f315e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e6ca8d3b6643a48b1dfb67dbedb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:41Z,use_quota=True,user_id='6bbb5208f8b049d195e83c500f530b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Creating volume 50e4882f-b46c-42b8-9492-15bdd85f315e {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:44 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:58:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:44 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e 1073741824 Jul 31 10:58:44 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:44 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c7641049-bd86-4530-8122-1f93c0665022 tempest-GroupSnapshotsTest-2116496244 None] group_snapshot 7fe03fb2-6af3-4a21-afb6-68c6154a7df5: created successfully Jul 31 10:58:45 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e 1073741824" returned: 0 in 0.701s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:45 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e Jul 31 10:58:45 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:45 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e" returned: 0 in 0.311s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.198s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-253828314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdbcc27-8846-42df-b0a7-9d0fbd36bd65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ad8b5038fa4b3abd6cfe254a6c7669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:44Z,use_quota=True,user_id='a650642f15b44b1fb2ace6ccacdd80af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Creating volume 0cdbcc27-8846-42df-b0a7-9d0fbd36bd65 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:45 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:45 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65 1073741824 Jul 31 10:58:45 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Attempting download of 73b2b0b0-b476-43bf-9b0b-2363c12be17d ((None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}])) to volume 50e4882f-b46c-42b8-9492-15bdd85f315e. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7b4a88-5d49-428e-a2ba-d421e67b00a3]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d__e9yy06s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:46 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d__e9yy06s Jul 31 10:58:46 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:46 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d__e9yy06s" returned: 0 in 0.414s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d__e9yy06s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:46 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65 1073741824" returned: 0 in 0.585s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:46 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65 Jul 31 10:58:46 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:46 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d__e9yy06s Jul 31 10:58:46 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:46 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65" returned: 0 in 0.312s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-9d07877e-4095-41de-9c9d-c3d0f9eb826a req-6a73764c-d009-4f7a-8f3e-440ab743b9df tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.139s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16683ad-63b8-4324-8ba8-9485f2eef362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:46 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d5c10a-9e90-4301-b034-7c87b35634c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d__e9yy06s" returned: 1 in 0.410s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d__e9yy06s' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:58:46 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Volume volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65 (0cdbcc27-8846-42df-b0a7-9d0fbd36bd65): created successfully Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d5c10a-9e90-4301-b034-7c87b35634c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Flow 'volume_create_manager' (8dedd68e-1823-42b7-8950-0809c1e30610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[d413e1fd-6e03-4db2-b881-a158fa702c72]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[204e4f71-b407-47eb-869b-eaeb0ad8ae91]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-9d07877e-4095-41de-9c9d-c3d0f9eb826a req-6a73764c-d009-4f7a-8f3e-440ab743b9df tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:46 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-89abce4b-8988-4496-8d2d-665a27b06990 tempest-VolumesMetadataTest-967272070 None] Created volume successfully. Jul 31 10:58:46 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD Jul 31 10:58:46 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:46 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 Jul 31 10:58:46 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:47 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] 73b2b0b0-b476-43bf-9b0b-2363c12be17d was qcow2, converting to raw {{(pid=89145) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:47 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e Jul 31 10:58:47 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:47 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-9d07877e-4095-41de-9c9d-c3d0f9eb826a req-6a73764c-d009-4f7a-8f3e-440ab743b9df tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50" returned: 0 in 0.463s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-9d07877e-4095-41de-9c9d-c3d0f9eb826a req-6a73764c-d009-4f7a-8f3e-440ab743b9df tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:47 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 Jul 31 10:58:47 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:47 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-9d07877e-4095-41de-9c9d-c3d0f9eb826a req-6a73764c-d009-4f7a-8f3e-440ab743b9df tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50" returned: 1 in 0.453s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-9d07877e-4095-41de-9c9d-c3d0f9eb826a req-6a73764c-d009-4f7a-8f3e-440ab743b9df tempest-TestInstancesWithCinderVolumes-528178718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-9d07877e-4095-41de-9c9d-c3d0f9eb826a req-6a73764c-d009-4f7a-8f3e-440ab743b9df tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.990s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.823s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-b9a2b78a-2b3f-419b-a905-8833d030c13a-9c2eb87f-4571-4f09-9337-22912a4d9fec" by "_create_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-b9a2b78a-2b3f-419b-a905-8833d030c13a-9c2eb87f-4571-4f09-9337-22912a4d9fec" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Creating volume 9c2eb87f-4571-4f09-9337-22912a4d9fec from snapshot b9a2b78a-2b3f-419b-a905-8833d030c13a {{(pid=89145) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-9c2eb87f-4571-4f09-9337-22912a4d9fec" by "_copy_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-9c2eb87f-4571-4f09-9337-22912a4d9fec" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] snapshot: b9a2b78a-2b3f-419b-a905-8833d030c13a, volume: 9c2eb87f-4571-4f09-9337-22912a4d9fec, {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-9d07877e-4095-41de-9c9d-c3d0f9eb826a req-6a73764c-d009-4f7a-8f3e-440ab743b9df tempest-TestInstancesWithCinderVolumes-528178718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85329c4e-30f9-4dc4-ba83-ae0b5ec7d617', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[177d5e08-9bf6-435b-9815-e43ccd2da231]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:48 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-9d07877e-4095-41de-9c9d-c3d0f9eb826a req-6a73764c-d009-4f7a-8f3e-440ab743b9df tempest-TestInstancesWithCinderVolumes-528178718 None] attachment_update completed successfully. Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Acquiring lock "cinder-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:48 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a Jul 31 10:58:48 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Lock "cinder-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Acquiring lock "cinder-quobyte-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Lock "cinder-quobyte-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65" acquired by "delete_volume" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a274936-fda0-462e-a850-4122b7863dee]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:48 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65 Jul 31 10:58:48 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:48 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a" returned: 0 in 0.554s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f37530e-8051-49ac-89c3-337d53fe40a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Creating direct copy from snapshot {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[0966e262-9e18-4c39-b26b-a91d9c091631]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:48 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 Jul 31 10:58:48 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:48 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65" returned: 0 in 0.499s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:48 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65 Jul 31 10:58:48 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:49 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2" returned: 0 in 0.580s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG cinder.utils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Path /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec not found in is_blk_device check {{(pid=89145) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:49 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec Jul 31 10:58:49 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:49 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65" returned: 0 in 0.606s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Lock "cinder-quobyte-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65" released by "delete_volume" :: held 1.176s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:49 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e" returned: 0 in 2.182s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_qwho3oopdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:58:49 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Converted 112.00 MB image at 51.22 MB/s Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:49 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e 1G Jul 31 10:58:49 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Created reservations ['dcbcbea0-852e-4a4d-9ead-336d561be70d', 'ba0d4670-15ef-466f-8576-f67119f53993', '74a5a519-67c8-40d8-b1e7-50b4c179f2ad', '6c7ff3af-6f58-4243-9060-0a2f1a96d540'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:49 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:58:49 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:50 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e 1G" returned: 0 in 0.612s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:50 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc66578-223d-4f9f-8d5e-c5ba6720f6d5]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:50 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e Jul 31 10:58:50 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:50 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.887s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:50 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:50 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Deleted volume successfully. Jul 31 10:58:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-b2240a73-af21-4731-9402-9195712282c6 tempest-VolumesMetadataTest-967272070 None] Lock "cinder-0cdbcc27-8846-42df-b0a7-9d0fbd36bd65-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:51 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e" returned: 0 in 1.056s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:51 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e Jul 31 10:58:51 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:52 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e" returned: 1 in 1.089s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:58:52 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Downloaded image 73b2b0b0-b476-43bf-9b0b-2363c12be17d ((None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}])) to volume 50e4882f-b46c-42b8-9492-15bdd85f315e successfully. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 10:58:52 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Temporary image 73b2b0b0-b476-43bf-9b0b-2363c12be17d for user 6bbb5208f8b049d195e83c500f530b0a is deleted. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 10:58:52 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Marking volume 50e4882f-b46c-42b8-9492-15bdd85f315e as bootable. {{(pid=89145) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 10:58:52 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Copying metadata from image 73b2b0b0-b476-43bf-9b0b-2363c12be17d to 50e4882f-b46c-42b8-9492-15bdd85f315e. {{(pid=89145) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 10:58:52 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Creating volume glance metadata for volume 50e4882f-b46c-42b8-9492-15bdd85f315e backed by image 73b2b0b0-b476-43bf-9b0b-2363c12be17d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89145) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 10:58:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64da2a6e-1a63-4291-b089-685caeda1393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e4882f-b46c-42b8-9492-15bdd85f315e', 'volume_size': 1, 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47167fa6716a45acb0b64b020ce63fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660b05dc-304c-4539-a0d7-f792c19141c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:52 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Volume volume-50e4882f-b46c-42b8-9492-15bdd85f315e (50e4882f-b46c-42b8-9492-15bdd85f315e): created successfully Jul 31 10:58:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660b05dc-304c-4539-a0d7-f792c19141c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Flow 'volume_create_manager' (cf8573b7-779f-4bbf-95a6-e2837d8a46a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e306dae4-f4d9-4d21-a97b-b1ff6e92a209 tempest-VolumesImageMetadata-1338309778 None] Created volume successfully. Jul 31 10:58:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Acquiring lock "cinder-50e4882f-b46c-42b8-9492-15bdd85f315e-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Lock "cinder-50e4882f-b46c-42b8-9492-15bdd85f315e-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Acquiring lock "cinder-quobyte-50e4882f-b46c-42b8-9492-15bdd85f315e" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Lock "cinder-quobyte-50e4882f-b46c-42b8-9492-15bdd85f315e" acquired by "delete_volume" :: waited 0.040s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:54 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2f0717-ceaf-49e5-8394-16dbe6adbf69]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:55 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e Jul 31 10:58:55 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:56 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e" returned: 0 in 1.564s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:56 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e Jul 31 10:58:56 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:57 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e" returned: 1 in 1.293s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:58:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:57 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec" returned: 0 in 8.653s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:57 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b104e7-2677-4033-adb6-b4effbb2b59e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:57 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e Jul 31 10:58:57 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:57 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 Jul 31 10:58:57 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:58 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-50e4882f-b46c-42b8-9492-15bdd85f315e" returned: 0 in 0.486s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Lock "cinder-quobyte-50e4882f-b46c-42b8-9492-15bdd85f315e" released by "delete_volume" :: held 3.582s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:58 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Created reservations ['63a88a6b-159b-48fb-9f8e-7bf5291a92ef', '0e316f82-6327-4d62-90d4-407628c0b3e6', '3b8f349b-4e3f-4a95-a620-fbf3b8e078d0', 'ff4573e5-7452-46d4-ae54-4f9ffe4fe982'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:58 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:58:58 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:58 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2" returned: 0 in 1.164s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:58 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2, size 1024.00 MB, duration 8.66 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:58:58 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Converted 1024.00 MB image at 118.26 MB/s Jul 31 10:58:58 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:58:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:59 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.535s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:59 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:59 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec Jul 31 10:58:59 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:59 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Deleted volume successfully. Jul 31 10:58:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-571aeeda-ac9c-4244-8792-917660ad22ce tempest-VolumesImageMetadata-1338309778 None] Lock "cinder-50e4882f-b46c-42b8-9492-15bdd85f315e-delete_volume" released by "delete_volume" :: held 4.593s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:59 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec" returned: 0 in 0.403s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-9c2eb87f-4571-4f09-9337-22912a4d9fec" released by "_copy_volume_from_snapshot" :: held 11.544s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-b9a2b78a-2b3f-419b-a905-8833d030c13a-9c2eb87f-4571-4f09-9337-22912a4d9fec" released by "_create_volume_from_snapshot" :: held 11.603s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.634s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:59 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4bc48aec-8f6b-4e8a-9fbc-f57c6a49eb99 tempest-GroupSnapshotsTest-2116496244 None] Create group from source-snapshot-7fe03fb2-6af3-4a21-afb6-68c6154a7df5 completed successfully. Jul 31 10:59:01 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=97,cinder:INSERT=32,cinder:UPDATE=91,cinder:DELETE=10 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:59:01 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=97,cinder:UPDATE=119,cinder:INSERT=32,cinder:DELETE=7 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:59:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-9c2eb87f-4571-4f09-9337-22912a4d9fec" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-9c2eb87f-4571-4f09-9337-22912a4d9fec" acquired by "delete_volume" :: waited 0.052s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:01 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[956d605c-cf17-47cf-8897-5f2c1bbdf64a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:01 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec Jul 31 10:59:01 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:01 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec" returned: 0 in 0.620s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:02 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec Jul 31 10:59:02 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:02 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9c2eb87f-4571-4f09-9337-22912a4d9fec" returned: 0 in 0.395s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-9c2eb87f-4571-4f09-9337-22912a4d9fec" released by "delete_volume" :: held 1.130s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:02 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['4eb7bb45-992a-49b7-8d58-f2482f27f221'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:02 devstack cinder-volume[89145]: WARNING cinder.quota [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-699741815 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-699741815, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:02 devstack cinder-volume[89145]: WARNING cinder.quota [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-699741815 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-699741815, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:02 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['0876e0f7-5ecd-4f51-891d-7540a4cd2b79', 'f32cd095-3ad4-427d-80a0-446d9a4749b4', 'eb0849b3-0808-456d-802a-98e15e579d3c', '73a304f6-cbc1-490e-9f2c-8bef8ec82a33'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:03 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:03 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Flow 'volume_create_manager' (443041cd-9c19-4adc-9d8f-bd6194438b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4ff50e-a39c-466c-9fbd-765fa832bd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4ff50e-a39c-466c-9fbd-765fa832bd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-808772469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340fc932-4015-4910-83a3-919153796d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a0478a686f4c04a1aad6d309c0b5c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:03Z,use_quota=True,user_id='0167aeba7e2b417c97ec994ad2c96e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e742c4d-e628-475a-b0d7-ea61a87a7cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e742c4d-e628-475a-b0d7-ea61a87a7cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800af9a1-5516-48ae-a7d3-580ba3052e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800af9a1-5516-48ae-a7d3-580ba3052e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340fc932-4015-4910-83a3-919153796d5c', 'volume_name': 'volume-340fc932-4015-4910-83a3-919153796d5c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44691106-cdb2-4f9b-8804-d18db4bc8bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44691106-cdb2-4f9b-8804-d18db4bc8bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66d1002-d03f-4e56-bb61-bd4767d7d2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:03 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Volume 340fc932-4015-4910-83a3-919153796d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340fc932-4015-4910-83a3-919153796d5c', 'volume_size': 1} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-808772469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340fc932-4015-4910-83a3-919153796d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a0478a686f4c04a1aad6d309c0b5c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:03Z,use_quota=True,user_id='0167aeba7e2b417c97ec994ad2c96e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Creating volume 340fc932-4015-4910-83a3-919153796d5c {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:03 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-340fc932-4015-4910-83a3-919153796d5c 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:03 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-340fc932-4015-4910-83a3-919153796d5c 1073741824 Jul 31 10:59:03 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:03 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.588s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:03 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:03 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c4eff8f9-a09e-4c9b-9136-49634e9a23eb tempest-GroupSnapshotsTest-2116496244 None] Delete group completed successfully. Jul 31 10:59:04 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] group_snapshot 7fe03fb2-6af3-4a21-afb6-68c6154a7df5: deleting Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] group_snapshot 7fe03fb2-6af3-4a21-afb6-68c6154a7df5: deleting {{(pid=89145) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-3f37530e-8051-49ac-89c3-337d53fe40a2" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-3f37530e-8051-49ac-89c3-337d53fe40a2" acquired by "delete_snapshot" :: waited 0.042s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-b9a2b78a-2b3f-419b-a905-8833d030c13a" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-b9a2b78a-2b3f-419b-a905-8833d030c13a" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Deleting offline snapshot b9a2b78a-2b3f-419b-a905-8833d030c13a of volume 3f37530e-8051-49ac-89c3-337d53fe40a2 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] snapshot_file for this snap is: volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d37a61-5790-4c28-85df-3530ef15f8eb]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:04 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-340fc932-4015-4910-83a3-919153796d5c 1073741824" returned: 0 in 0.907s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-340fc932-4015-4910-83a3-919153796d5c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:04 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-340fc932-4015-4910-83a3-919153796d5c Jul 31 10:59:04 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:04 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a Jul 31 10:59:04 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:04 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a" returned: 0 in 0.540s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f37530e-8051-49ac-89c3-337d53fe40a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[208bfb22-9bae-4649-9c02-4dcf47f0fe2d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:04 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-340fc932-4015-4910-83a3-919153796d5c" returned: 0 in 0.529s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66d1002-d03f-4e56-bb61-bd4767d7d2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340fc932-4015-4910-83a3-919153796d5c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b406c2c-4f83-4621-b0b8-b50a7f01a893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Volume volume-340fc932-4015-4910-83a3-919153796d5c (340fc932-4015-4910-83a3-919153796d5c): created successfully Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b406c2c-4f83-4621-b0b8-b50a7f01a893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Flow 'volume_create_manager' (443041cd-9c19-4adc-9d8f-bd6194438b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:05 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-be50b652-1a07-4dfb-b88c-1dd04c8c1c97 tempest-VolumesTransfersTest-2016363011 None] Created volume successfully. Jul 31 10:59:05 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 Jul 31 10:59:05 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:05 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2" returned: 0 in 0.708s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:05 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a Jul 31 10:59:05 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Flow 'volume_create_manager' (dfb8af9d-a558-4128-9142-1a667a13527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6451b625-d3f9-4475-ad91-770b56bea351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6451b625-d3f9-4475-ad91-770b56bea351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-588586998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e6bc17-767c-452c-b12d-3acbf3c4d13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e859a511bfd41cdbbc8e73ace6a4e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:06Z,use_quota=True,user_id='dadd6dc534134c50b27f5b6197748463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb9c894-39b7-457a-9609-89cd3a42915b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb9c894-39b7-457a-9609-89cd3a42915b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ab889c-3327-4a0a-bc33-78e085101437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ab889c-3327-4a0a-bc33-78e085101437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e6bc17-767c-452c-b12d-3acbf3c4d13a', 'volume_name': 'volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e8e4ca-50aa-4d76-af1b-0d60a056571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e8e4ca-50aa-4d76-af1b-0d60a056571f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280940d9-2427-44ab-bbc6-40b95cd3599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Volume 82e6bc17-767c-452c-b12d-3acbf3c4d13a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a', 'volume_size': 1} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-588586998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e6bc17-767c-452c-b12d-3acbf3c4d13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e859a511bfd41cdbbc8e73ace6a4e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:06Z,use_quota=True,user_id='dadd6dc534134c50b27f5b6197748463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Creating volume 82e6bc17-767c-452c-b12d-3acbf3c4d13a {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:05 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:05 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a 1073741824 Jul 31 10:59:05 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:06 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a" returned: 0 in 0.555s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:06 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a Jul 31 10:59:06 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:06 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2.b9a2b78a-2b3f-419b-a905-8833d030c13a" returned: 0 in 0.417s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:06 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a 1073741824" returned: 0 in 0.691s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-b9a2b78a-2b3f-419b-a905-8833d030c13a" released by "_delete_snapshot" :: held 2.409s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-3f37530e-8051-49ac-89c3-337d53fe40a2" released by "delete_snapshot" :: held 2.479s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:06 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a Jul 31 10:59:06 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:06 devstack cinder-volume[89145]: WARNING cinder.quota [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-699741815 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-699741815, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:06 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-401e2b4b-bf24-4fad-ad9e-0ac42e6b2405 tempest-VolumesTransfersTest-51409461 None] Transfer volume completed successfully. Jul 31 10:59:06 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['2c1a8340-dda9-4234-bb7f-d95cf7094ea8', '8c6a5e88-4316-4c13-95dc-fa5727fc4567', '8e6201f7-8d75-4c63-bd79-c115ec090783', '748a3451-c1ca-4d36-adbb-161b50f86e5a'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:07 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f90b2b01-0c48-4409-872e-bdd98c0a3a23 tempest-GroupSnapshotsTest-2116496244 None] group_snapshot 7fe03fb2-6af3-4a21-afb6-68c6154a7df5: deleted successfully Jul 31 10:59:07 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a" returned: 0 in 0.390s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280940d9-2427-44ab-bbc6-40b95cd3599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f81b6e-5065-489e-8121-12595613c663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:07 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Volume volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a (82e6bc17-767c-452c-b12d-3acbf3c4d13a): created successfully Jul 31 10:59:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f81b6e-5065-489e-8121-12595613c663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Flow 'volume_create_manager' (dfb8af9d-a558-4128-9142-1a667a13527c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:07 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-65910cdc-25b8-4752-8cb6-0bc938b7eaa9 tempest-SnapshotMetadataTestJSON-1305482415 None] Created volume successfully. Jul 31 10:59:07 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Acquiring lock "cinder-340fc932-4015-4910-83a3-919153796d5c-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Lock "cinder-340fc932-4015-4910-83a3-919153796d5c-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Acquiring lock "cinder-quobyte-340fc932-4015-4910-83a3-919153796d5c" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Lock "cinder-quobyte-340fc932-4015-4910-83a3-919153796d5c" acquired by "delete_volume" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eccb4a1-a26d-4254-8ac2-6a2cb34865c9]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-340fc932-4015-4910-83a3-919153796d5c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] Creating offline snapshot 21067f05-7fc5-434b-8073-0527251e9de1 of volume 82e6bc17-767c-452c-b12d-3acbf3c4d13a {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:59:08 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:08 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa0ec19-3cc5-4347-b933-79a9b8bf0c93]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:08 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-340fc932-4015-4910-83a3-919153796d5c Jul 31 10:59:08 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:08 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a Jul 31 10:59:08 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-3f37530e-8051-49ac-89c3-337d53fe40a2" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-3f37530e-8051-49ac-89c3-337d53fe40a2" acquired by "delete_volume" :: waited 0.048s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:08 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.487s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f4127-5f57-4e25-8280-36ab292c331f]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:08 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-340fc932-4015-4910-83a3-919153796d5c" returned: 0 in 0.702s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-340fc932-4015-4910-83a3-919153796d5c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:08 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 Jul 31 10:59:08 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:08 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-340fc932-4015-4910-83a3-919153796d5c Jul 31 10:59:08 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:08 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a" returned: 0 in 0.682s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:09 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 1G Jul 31 10:59:09 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:09 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-340fc932-4015-4910-83a3-919153796d5c" returned: 0 in 0.310s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Lock "cinder-quobyte-340fc932-4015-4910-83a3-919153796d5c" released by "delete_volume" :: held 1.094s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:09 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2" returned: 0 in 0.538s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Created reservations ['274adfcd-508d-46be-b256-70579a8e3dad', 'a40e0a50-30aa-462e-808f-dec9ba0ccb68', '728c2dd1-723e-4398-824f-6faf593c2140', '15d99edd-c7b6-4d22-bdd5-796d7245b54a'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:09 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2 Jul 31 10:59:09 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:09 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:09 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:09 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 1G" returned: 0 in 0.584s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:09 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:09 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 Jul 31 10:59:09 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3f37530e-8051-49ac-89c3-337d53fe40a2" returned: 0 in 0.308s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-3f37530e-8051-49ac-89c3-337d53fe40a2" released by "delete_volume" :: held 0.934s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:09 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.297s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['66ac9885-e17a-4977-946d-8b41a9f3e793'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:09 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Deleted volume successfully. Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e5378523-c49e-4a19-95fa-574194f9d905 tempest-VolumesTransfersTest-1933179445 None] Lock "cinder-340fc932-4015-4910-83a3-919153796d5c-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:09 devstack cinder-volume[89145]: WARNING cinder.db.api [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-699741815'] Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['8724c4e5-9929-43c0-bbe1-083d4d1c2e80', '8089d366-e031-488c-ab57-e65a573dfb7d', '7e942795-47b4-4ba0-ad42-d912e6222d9c', 'f9282f9a-062e-4923-b3ca-2963707be568'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:09 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1" returned: 0 in 0.367s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:09 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 is being set with open permissions: ugo+rw Jul 31 10:59:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:09 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:09 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:09 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 Jul 31 10:59:09 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:10 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.292s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:10 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6419208e-eb19-4114-903e-ba0731a7751b tempest-GroupSnapshotsTest-2116496244 None] Delete group completed successfully. Jul 31 10:59:10 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1" returned: 0 in 0.353s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:10 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.info Jul 31 10:59:10 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-581e28eb-79bd-4b44-837e-81515681ee88 tempest-GroupSnapshotsTest-2116496244 None] Group tempest-GroupSnapshotsTest-Group-1405604689: creating Jul 31 10:59:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-581e28eb-79bd-4b44-837e-81515681ee88 tempest-GroupSnapshotsTest-2116496244 None] Group tempest-GroupSnapshotsTest-Group-1405604689: created successfully Jul 31 10:59:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-581e28eb-79bd-4b44-837e-81515681ee88 tempest-GroupSnapshotsTest-2116496244 None] Create group completed successfully. Jul 31 10:59:10 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.info" returned: 0 in 0.487s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:10 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.info is being set with open permissions: ugo+rw Jul 31 10:59:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:10 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.info Jul 31 10:59:10 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Flow 'volume_create_manager' (cad4b2ef-3aa9-4f2c-867a-be776ab93b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15b9445-e61f-46d2-894b-f5ef269be668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15b9445-e61f-46d2-894b-f5ef269be668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-201505697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272f7ef1-6901-4326-9f58-ebbf9c1d1850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a0478a686f4c04a1aad6d309c0b5c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:11Z,use_quota=True,user_id='0167aeba7e2b417c97ec994ad2c96e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcab3e6-da2e-4eaf-b4d8-611cc6ea2f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcab3e6-da2e-4eaf-b4d8-611cc6ea2f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3736c15d-1875-4c84-a149-7e9d0ed2a5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3736c15d-1875-4c84-a149-7e9d0ed2a5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272f7ef1-6901-4326-9f58-ebbf9c1d1850', 'volume_name': 'volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066cf31c-e144-4ced-bc7d-99cd62842d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066cf31c-e144-4ced-bc7d-99cd62842d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3ee093-d77d-4b8a-970b-e874eee4e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:11 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Volume 272f7ef1-6901-4326-9f58-ebbf9c1d1850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850', 'volume_size': 1} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:11 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.info" returned: 0 in 0.422s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.097s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-201505697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272f7ef1-6901-4326-9f58-ebbf9c1d1850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a0478a686f4c04a1aad6d309c0b5c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:11Z,use_quota=True,user_id='0167aeba7e2b417c97ec994ad2c96e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Creating volume 272f7ef1-6901-4326-9f58-ebbf9c1d1850 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:11 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:11 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850 1073741824 Jul 31 10:59:11 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:11 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-32b86edb-65a1-4f9e-b07f-af9135a08870 tempest-SnapshotMetadataTestJSON-1305482415 None] Create snapshot completed successfully Jul 31 10:59:11 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850 1073741824" returned: 0 in 0.566s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:11 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850 Jul 31 10:59:11 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:12 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850" returned: 0 in 0.367s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3ee093-d77d-4b8a-970b-e874eee4e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5bd15d-9908-4dbe-9181-b58bbb424927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Flow 'volume_create_manager' (18d2d8e6-144d-421f-9aa5-d4524518f567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8463d71e-ece7-4b49-92f6-9ec665ea7f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8463d71e-ece7-4b49-92f6-9ec665ea7f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1700804987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6744569f-52bb-4825-be38-80389a4eecb8,host='devstack@QuobyteHD#QuobyteHD',id=eb8c3459-7841-4436-8bdc-f0788719601e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb6f9dd568a4d1abc71caf0904f3138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:12Z,use_quota=True,user_id='435c53f9c16c4cf5801111dae4b77281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(444e6fe0-6f00-47c7-a9df-0fea6a508ddb),volume_type_id=444e6fe0-6f00-47c7-a9df-0fea6a508ddb)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9d0e36-6362-4588-abc9-51daf3d24bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9d0e36-6362-4588-abc9-51daf3d24bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244496d0-0abb-47a2-89c1-ac14b8dab4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244496d0-0abb-47a2-89c1-ac14b8dab4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb8c3459-7841-4436-8bdc-f0788719601e', 'volume_name': 'volume-eb8c3459-7841-4436-8bdc-f0788719601e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15495093-eb30-48ca-a904-541e14e4d2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15495093-eb30-48ca-a904-541e14e4d2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4067995c-225a-46a1-933c-c62c21ef7018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:12 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Volume eb8c3459-7841-4436-8bdc-f0788719601e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb8c3459-7841-4436-8bdc-f0788719601e', 'volume_size': 1} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6744569f-52bb-4825-be38-80389a4eecb8,created_at=2026-07-31T08:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1700804987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6744569f-52bb-4825-be38-80389a4eecb8,host='devstack@QuobyteHD#QuobyteHD',id=eb8c3459-7841-4436-8bdc-f0788719601e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb6f9dd568a4d1abc71caf0904f3138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:12Z,use_quota=True,user_id='435c53f9c16c4cf5801111dae4b77281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(444e6fe0-6f00-47c7-a9df-0fea6a508ddb),volume_type_id=444e6fe0-6f00-47c7-a9df-0fea6a508ddb)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Creating volume eb8c3459-7841-4436-8bdc-f0788719601e {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:12 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:12 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Volume volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850 (272f7ef1-6901-4326-9f58-ebbf9c1d1850): created successfully Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5bd15d-9908-4dbe-9181-b58bbb424927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Flow 'volume_create_manager' (cad4b2ef-3aa9-4f2c-867a-be776ab93b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:12 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e 1073741824 Jul 31 10:59:12 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:12 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3e4e1a7a-f63c-4e11-a780-877281bfc61d tempest-VolumesTransfersTest-2016363011 None] Created volume successfully. Jul 31 10:59:13 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e 1073741824" returned: 0 in 0.523s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:13 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e Jul 31 10:59:13 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Acquiring lock "cinder-21067f05-7fc5-434b-8073-0527251e9de1-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "cinder-21067f05-7fc5-434b-8073-0527251e9de1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Acquiring lock "cinder-quobyte-82e6bc17-767c-452c-b12d-3acbf3c4d13a" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "cinder-quobyte-82e6bc17-767c-452c-b12d-3acbf3c4d13a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Acquiring lock "cinder-quobyte-21067f05-7fc5-434b-8073-0527251e9de1" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "cinder-quobyte-21067f05-7fc5-434b-8073-0527251e9de1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Deleting offline snapshot 21067f05-7fc5-434b-8073-0527251e9de1 of volume 82e6bc17-767c-452c-b12d-3acbf3c4d13a {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] snapshot_file for this snap is: volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb52e2b-84cf-4d00-be54-cda5b6601d25]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:13 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e" returned: 0 in 0.329s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4067995c-225a-46a1-933c-c62c21ef7018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb8c3459-7841-4436-8bdc-f0788719601e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a48608-ad93-4123-b1aa-2c0aced37eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:13 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Volume volume-eb8c3459-7841-4436-8bdc-f0788719601e (eb8c3459-7841-4436-8bdc-f0788719601e): created successfully Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a48608-ad93-4123-b1aa-2c0aced37eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Flow 'volume_create_manager' (18d2d8e6-144d-421f-9aa5-d4524518f567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:13 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d44e2d86-ee5f-4817-8e2e-8bc228b3e6af tempest-GroupSnapshotsTest-2116496244 None] Created volume successfully. Jul 31 10:59:13 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 Jul 31 10:59:13 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Acquiring lock "cinder-272f7ef1-6901-4326-9f58-ebbf9c1d1850-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Lock "cinder-272f7ef1-6901-4326-9f58-ebbf9c1d1850-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Acquiring lock "cinder-quobyte-272f7ef1-6901-4326-9f58-ebbf9c1d1850" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Lock "cinder-quobyte-272f7ef1-6901-4326-9f58-ebbf9c1d1850" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed8e2b3-d5b8-4cc0-b2bc-56be2f03e3fd]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:13 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1" returned: 0 in 0.426s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:13 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850 Jul 31 10:59:13 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0c6c24-bcfd-46f0-bd14-c2cc8cffc5f1]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:13 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a Jul 31 10:59:13 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:14 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850" returned: 0 in 0.388s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:14 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850 Jul 31 10:59:14 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:14 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a" returned: 0 in 0.394s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:14 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 Jul 31 10:59:14 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:14 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-272f7ef1-6901-4326-9f58-ebbf9c1d1850" returned: 0 in 0.262s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Lock "cinder-quobyte-272f7ef1-6901-4326-9f58-ebbf9c1d1850" released by "delete_volume" :: held 0.691s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Created reservations ['671a531d-e358-435c-80a3-80b28898c3cf', '2a793bc7-4c48-46a7-8edb-2f475188c052', '2c6594c9-eef3-4478-bf9f-2c22d804623a', '6d87de6a-9a61-49d2-8f10-e0b176a4dd90'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:14 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:14 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:14 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1" returned: 0 in 0.374s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:14 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1 Jul 31 10:59:14 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:14 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.275s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:14 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Deleted volume successfully. Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-34952cbe-c07a-49e9-a593-26d7b8ab589c tempest-VolumesTransfersTest-1933179445 None] Lock "cinder-272f7ef1-6901-4326-9f58-ebbf9c1d1850-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:14 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a.21067f05-7fc5-434b-8073-0527251e9de1" returned: 0 in 0.329s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "cinder-quobyte-21067f05-7fc5-434b-8073-0527251e9de1" released by "_delete_snapshot" :: held 1.667s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "cinder-quobyte-82e6bc17-767c-452c-b12d-3acbf3c4d13a" released by "delete_snapshot" :: held 1.700s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Created reservations ['ecc68db6-cea9-432e-96d0-b0847cd8814e', 'c58d2fb1-6ef8-4a16-b86c-713dfd011598', 'f78fe2f9-9e85-4403-9548-8266819ae5f7', '155ec6c4-636c-49cf-a08d-432bca2cb60c'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:15 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Delete snapshot completed successfully. Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f6b16003-843e-495d-8b46-5bc66e824ba9 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "cinder-21067f05-7fc5-434b-8073-0527251e9de1-delete_snapshot" released by "delete_snapshot" :: held 1.882s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Flow 'volume_create_manager' (94536691-df03-4448-ba99-67f7921ef57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5f5028-dbe5-47d7-81b8-27a587f7f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5f5028-dbe5-47d7-81b8-27a587f7f13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1251197368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6744569f-52bb-4825-be38-80389a4eecb8,host='devstack@QuobyteHD#QuobyteHD',id=6dd96b94-f0b0-4eb9-89de-5b127c255673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb6f9dd568a4d1abc71caf0904f3138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:15Z,use_quota=True,user_id='435c53f9c16c4cf5801111dae4b77281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(444e6fe0-6f00-47c7-a9df-0fea6a508ddb),volume_type_id=444e6fe0-6f00-47c7-a9df-0fea6a508ddb)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29355a1-a139-401f-ba0d-15dc987fc4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29355a1-a139-401f-ba0d-15dc987fc4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5080e1-25ad-4a50-bf74-4cd1ec395653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5080e1-25ad-4a50-bf74-4cd1ec395653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd96b94-f0b0-4eb9-89de-5b127c255673', 'volume_name': 'volume-6dd96b94-f0b0-4eb9-89de-5b127c255673', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5c0029-da6e-44ff-b16a-ba983b49b7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5c0029-da6e-44ff-b16a-ba983b49b7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f978ee37-8fc6-40bc-835c-57b73defa767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:15 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Volume 6dd96b94-f0b0-4eb9-89de-5b127c255673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd96b94-f0b0-4eb9-89de-5b127c255673', 'volume_size': 1} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6744569f-52bb-4825-be38-80389a4eecb8,created_at=2026-07-31T08:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1251197368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6744569f-52bb-4825-be38-80389a4eecb8,host='devstack@QuobyteHD#QuobyteHD',id=6dd96b94-f0b0-4eb9-89de-5b127c255673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb6f9dd568a4d1abc71caf0904f3138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:15Z,use_quota=True,user_id='435c53f9c16c4cf5801111dae4b77281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(444e6fe0-6f00-47c7-a9df-0fea6a508ddb),volume_type_id=444e6fe0-6f00-47c7-a9df-0fea6a508ddb)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Creating volume 6dd96b94-f0b0-4eb9-89de-5b127c255673 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:15 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Acquiring lock "cinder-82e6bc17-767c-452c-b12d-3acbf3c4d13a-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:15 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 1073741824 Jul 31 10:59:15 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "cinder-82e6bc17-767c-452c-b12d-3acbf3c4d13a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Acquiring lock "cinder-quobyte-82e6bc17-767c-452c-b12d-3acbf3c4d13a" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "cinder-quobyte-82e6bc17-767c-452c-b12d-3acbf3c4d13a" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3389130b-bd78-4c5e-929f-456b2c1c1167]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:15 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a Jul 31 10:59:15 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:16 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 1073741824" returned: 0 in 0.554s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:16 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a" returned: 0 in 0.421s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:16 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a Jul 31 10:59:16 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:16 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 Jul 31 10:59:16 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:16 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-82e6bc17-767c-452c-b12d-3acbf3c4d13a" returned: 0 in 0.333s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:16 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673" returned: 0 in 0.319s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "cinder-quobyte-82e6bc17-767c-452c-b12d-3acbf3c4d13a" released by "delete_volume" :: held 0.833s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f978ee37-8fc6-40bc-835c-57b73defa767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd96b94-f0b0-4eb9-89de-5b127c255673', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e47ce01-0cb2-47cc-8d4b-de65b2f973f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:16 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Volume volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 (6dd96b94-f0b0-4eb9-89de-5b127c255673): created successfully Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e47ce01-0cb2-47cc-8d4b-de65b2f973f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Flow 'volume_create_manager' (94536691-df03-4448-ba99-67f7921ef57b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:16 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-03b84e71-7308-434c-8ab5-1e41e5579e6b tempest-GroupSnapshotsTest-2116496244 None] Created volume successfully. Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Created reservations ['5db1e2d5-53c9-48b8-92c9-f86acee575b9', '5ce17f3f-b44a-4dfe-8279-2ed5e4621bfb', '167a8d27-1676-46b6-8dd5-8737f08c3c10', 'fd2e5a6e-b573-400f-83e9-e4ed8074c77f'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:16 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:16 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:17 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.334s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:17 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:17 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Deleted volume successfully. Jul 31 10:59:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1d467344-9c0e-44f5-bcf4-ceb60d18bcb1 tempest-SnapshotMetadataTestJSON-1305482415 None] Lock "cinder-82e6bc17-767c-452c-b12d-3acbf3c4d13a-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:18 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1e68a555-c9a7-4eb7-9a99-c1ea35212488 tempest-GroupSnapshotsTest-2116496244 None] Update group completed successfully. Jul 31 10:59:19 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1bd880f3-65ea-4bc9-9f80-4b03d0455782 tempest-GroupSnapshotsTest-2116496244 None] Update group completed successfully. Jul 31 10:59:20 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-01991477-b0be-4993-a88b-bc799c161a09 tempest-GroupSnapshotsTest-2116496244 None] Update group completed successfully. Jul 31 10:59:21 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-accd5dc8-67a8-4cfa-9748-0c88b84833f9 tempest-GroupSnapshotsTest-2116496244 None] Update group completed successfully. Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Flow 'volume_create_manager' (b2926910-1cb5-4c3d-b06e-e9889bde88c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a331828-d1df-4feb-b7d8-f76e33f802c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a331828-d1df-4feb-b7d8-f76e33f802c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1903984333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f06c0d-3510-4268-8c61-a222bbcd22a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219eadf3698e4b65a1c081e36343e6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:22Z,use_quota=True,user_id='c1287c2f4c9e428f842fb10f2416e373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de344cea-b1eb-4708-8012-ced29f2b6bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de344cea-b1eb-4708-8012-ced29f2b6bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78288ad1-8aed-464e-a124-17505d421998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78288ad1-8aed-464e-a124-17505d421998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f06c0d-3510-4268-8c61-a222bbcd22a8', 'volume_name': 'volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b33348e-eabb-4980-973c-e05c74b45722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b33348e-eabb-4980-973c-e05c74b45722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d083a17-3a95-4909-a4ec-1e6234a2a71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:22 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Volume a2f06c0d-3510-4268-8c61-a222bbcd22a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8', 'volume_size': 1} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1903984333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f06c0d-3510-4268-8c61-a222bbcd22a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219eadf3698e4b65a1c081e36343e6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:22Z,use_quota=True,user_id='c1287c2f4c9e428f842fb10f2416e373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Creating volume a2f06c0d-3510-4268-8c61-a222bbcd22a8 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:22 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:22 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8 1073741824 Jul 31 10:59:22 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:23 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] GroupSnapshot 4f09966e-7718-4d34-86dd-7b9293c10665: creating. Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Group snapshot 4f09966e-7718-4d34-86dd-7b9293c10665: creating. {{(pid=89145) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-4d79274b-c63f-4f7a-9530-e56e19d5bd2e req-0d668cb2-00f7-4a8d-ba19-bc8481560fae tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:23 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8 1073741824" returned: 0 in 0.675s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:23 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8 Jul 31 10:59:23 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:23 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8" returned: 0 in 0.266s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.620s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Creating offline snapshot 3bf4e210-3932-4212-8a4f-73d1482fcad7 of volume 6dd96b94-f0b0-4eb9-89de-5b127c255673 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d083a17-3a95-4909-a4ec-1e6234a2a71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de030458-ac52-4f4f-b239-fd8afa7f5b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fbad9e-4b3c-40fd-ba74-47b66ee7b891]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:23 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Volume volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8 (a2f06c0d-3510-4268-8c61-a222bbcd22a8): created successfully Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de030458-ac52-4f4f-b239-fd8afa7f5b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Flow 'volume_create_manager' (b2926910-1cb5-4c3d-b06e-e9889bde88c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:23 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ef368df3-8217-4d05-9ae8-ae937aeddee4 tempest-AbsoluteLimitsTests-1799227126 None] Created volume successfully. Jul 31 10:59:23 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 Jul 31 10:59:23 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Flow 'volume_create_manager' (f45d7108-9477-4c2c-adad-28f1463be0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a305b700-ac99-41f2-b08a-7d8a8aaec889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a305b700-ac99-41f2-b08a-7d8a8aaec889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-474496753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789fab2c-3ed8-4dac-8067-afe8f2376dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965924b3dc404ac1864be163cc88d1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:24Z,use_quota=True,user_id='94532a0fcd334b828beadbd4a6553bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc732aa7-c0b7-4c09-8f4b-e8a7c607d864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc732aa7-c0b7-4c09-8f4b-e8a7c607d864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2385ef04-b3b4-41ce-9cb0-ee2576f1a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2385ef04-b3b4-41ce-9cb0-ee2576f1a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '789fab2c-3ed8-4dac-8067-afe8f2376dc5', 'volume_name': 'volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7aecf6-bfef-46df-88c3-eb0662bba3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7aecf6-bfef-46df-88c3-eb0662bba3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e95f62c-27b0-4fd0-82e9-7f4b12b3e591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:24 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Volume 789fab2c-3ed8-4dac-8067-afe8f2376dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5', 'volume_size': 1} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:24 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673" returned: 0 in 0.412s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:24 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 1G Jul 31 10:59:24 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Acquiring lock "cinder-a2f06c0d-3510-4268-8c61-a222bbcd22a8-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Lock "cinder-a2f06c0d-3510-4268-8c61-a222bbcd22a8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Acquiring lock "cinder-quobyte-a2f06c0d-3510-4268-8c61-a222bbcd22a8" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Lock "cinder-quobyte-a2f06c0d-3510-4268-8c61-a222bbcd22a8" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40ab614-4e82-4630-825b-be4065298984]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:24 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 1G" returned: 0 in 0.449s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:24 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 Jul 31 10:59:24 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:24 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8 Jul 31 10:59:24 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:24 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7" returned: 0 in 0.320s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:24 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:24 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:24 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 Jul 31 10:59:24 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8" returned: 0 in 0.382s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:25 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8 Jul 31 10:59:25 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:25 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7" returned: 0 in 0.258s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:25 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a2f06c0d-3510-4268-8c61-a222bbcd22a8" returned: 0 in 0.259s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:25 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.info Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Lock "cinder-quobyte-a2f06c0d-3510-4268-8c61-a222bbcd22a8" released by "delete_volume" :: held 0.690s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:25 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Created reservations ['4ede8b13-e1c9-4af3-bcc5-2d0a00770f55', 'b95adefe-f1ba-4b1e-8e8d-7879227ff4d7', '54d989eb-443e-497c-9ff4-2ffd9a9f38a9', 'f7cb5dcc-4b7f-4337-97f7-79e04fc7a6cd'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:25 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:25 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:25 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.info" returned: 0 in 0.319s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:25 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:25 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.info Jul 31 10:59:25 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:25 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.336s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:25 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Deleted volume successfully. Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-871ac20c-c182-4aad-909c-d3f852960910 tempest-AbsoluteLimitsTests-1799227126 None] Lock "cinder-a2f06c0d-3510-4268-8c61-a222bbcd22a8-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:25 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.info" returned: 0 in 0.318s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Creating offline snapshot 941dc701-301b-4371-a7ac-80a19d36462e of volume eb8c3459-7841-4436-8bdc-f0788719601e {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[639dda42-8837-483c-abad-ddc1f3bc8303]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:26 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e Jul 31 10:59:26 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:26 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e" returned: 0 in 0.427s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:26 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e 1G Jul 31 10:59:26 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:26 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e 1G" returned: 0 in 0.515s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb8c3459-7841-4436-8bdc-f0788719601e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:26 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb8c3459-7841-4436-8bdc-f0788719601e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e Jul 31 10:59:26 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:27 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb8c3459-7841-4436-8bdc-f0788719601e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e" returned: 0 in 0.378s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:27 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:59:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:27 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e Jul 31 10:59:27 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:27 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e" returned: 0 in 0.262s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:27 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.info Jul 31 10:59:27 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:27 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.info" returned: 0 in 0.287s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:27 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:59:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:27 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.info Jul 31 10:59:27 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:28 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.info" returned: 0 in 0.293s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.025s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-474496753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789fab2c-3ed8-4dac-8067-afe8f2376dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965924b3dc404ac1864be163cc88d1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:24Z,use_quota=True,user_id='94532a0fcd334b828beadbd4a6553bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Creating volume 789fab2c-3ed8-4dac-8067-afe8f2376dc5 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:28 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:28 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5 1073741824 Jul 31 10:59:28 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:28 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1a23eea0-8927-4fc1-b12d-5497122dc36d tempest-GroupSnapshotsTest-2116496244 None] group_snapshot 4f09966e-7718-4d34-86dd-7b9293c10665: created successfully Jul 31 10:59:28 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] group_snapshot 4f09966e-7718-4d34-86dd-7b9293c10665: deleting Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] group_snapshot 4f09966e-7718-4d34-86dd-7b9293c10665: deleting {{(pid=89145) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-6dd96b94-f0b0-4eb9-89de-5b127c255673" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-6dd96b94-f0b0-4eb9-89de-5b127c255673" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-3bf4e210-3932-4212-8a4f-73d1482fcad7" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-3bf4e210-3932-4212-8a4f-73d1482fcad7" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Deleting offline snapshot 3bf4e210-3932-4212-8a4f-73d1482fcad7 of volume 6dd96b94-f0b0-4eb9-89de-5b127c255673 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] snapshot_file for this snap is: volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dd5629-2da8-4da6-964f-7696de066942]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:28 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5 1073741824" returned: 0 in 0.703s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:28 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5 Jul 31 10:59:28 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:29 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 Jul 31 10:59:29 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:29 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5" returned: 0 in 0.317s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-4d79274b-c63f-4f7a-9530-e56e19d5bd2e req-0d668cb2-00f7-4a8d-ba19-bc8481560fae tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e95f62c-27b0-4fd0-82e9-7f4b12b3e591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33bb3a3e-1c7d-456f-b737-287f21dd59d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[35097b22-323e-4b2a-b6ef-d02756cf7288]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-4d79274b-c63f-4f7a-9530-e56e19d5bd2e req-0d668cb2-00f7-4a8d-ba19-bc8481560fae tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:29 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7" returned: 0 in 0.467s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dd96b94-f0b0-4eb9-89de-5b127c255673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:29 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Volume volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5 (789fab2c-3ed8-4dac-8067-afe8f2376dc5): created successfully Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33bb3a3e-1c7d-456f-b737-287f21dd59d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Flow 'volume_create_manager' (f45d7108-9477-4c2c-adad-28f1463be0ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c19e83-a659-4e72-9c2b-294200184af0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b356878a-b86e-4949-977f-b185142baae3 tempest-VolumesTransfersV357Test-379153289 None] Created volume successfully. Jul 31 10:59:29 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f Jul 31 10:59:29 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:29 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 Jul 31 10:59:29 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:29 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673" returned: 0 in 0.605s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:30 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 Jul 31 10:59:30 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:30 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-4d79274b-c63f-4f7a-9530-e56e19d5bd2e req-0d668cb2-00f7-4a8d-ba19-bc8481560fae tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f" returned: 0 in 0.768s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-4d79274b-c63f-4f7a-9530-e56e19d5bd2e req-0d668cb2-00f7-4a8d-ba19-bc8481560fae tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.806s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-4d79274b-c63f-4f7a-9530-e56e19d5bd2e req-0d668cb2-00f7-4a8d-ba19-bc8481560fae tempest-TestInstancesWithCinderVolumes-528178718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-eb1c331f-4c68-4201-b006-5a23879e1f9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bdd718d-e26c-48eb-acc3-8e9e65d727e4', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:59:30 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-4d79274b-c63f-4f7a-9530-e56e19d5bd2e req-0d668cb2-00f7-4a8d-ba19-bc8481560fae tempest-TestInstancesWithCinderVolumes-528178718 None] attachment_update completed successfully. Jul 31 10:59:30 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7" returned: 0 in 0.588s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:30 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7 Jul 31 10:59:30 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:30 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-bca5e052-5749-404e-96a9-53f7060e5c13 tempest-VolumesTransfersV357Test-1422877034 None] Transfer volume completed successfully. Jul 31 10:59:30 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673.3bf4e210-3932-4212-8a4f-73d1482fcad7" returned: 0 in 0.384s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-3bf4e210-3932-4212-8a4f-73d1482fcad7" released by "_delete_snapshot" :: held 2.258s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-6dd96b94-f0b0-4eb9-89de-5b127c255673" released by "delete_snapshot" :: held 2.303s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-eb8c3459-7841-4436-8bdc-f0788719601e" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-eb8c3459-7841-4436-8bdc-f0788719601e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-941dc701-301b-4371-a7ac-80a19d36462e" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-941dc701-301b-4371-a7ac-80a19d36462e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Deleting offline snapshot 941dc701-301b-4371-a7ac-80a19d36462e of volume eb8c3459-7841-4436-8bdc-f0788719601e {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] snapshot_file for this snap is: volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[800ea382-59bd-474c-a840-70aefb338e9b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:31 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e Jul 31 10:59:31 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:31 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e" returned: 0 in 0.488s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb8c3459-7841-4436-8bdc-f0788719601e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e364ea-f522-49ce-a076-96b89a55f67d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:31 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e Jul 31 10:59:31 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Acquiring lock "cinder-789fab2c-3ed8-4dac-8067-afe8f2376dc5-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Lock "cinder-789fab2c-3ed8-4dac-8067-afe8f2376dc5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Acquiring lock "cinder-quobyte-789fab2c-3ed8-4dac-8067-afe8f2376dc5" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Lock "cinder-quobyte-789fab2c-3ed8-4dac-8067-afe8f2376dc5" acquired by "delete_volume" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a45c6e-8910-456a-a12d-648715f14027]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:32 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e" returned: 0 in 0.438s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:32 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e Jul 31 10:59:32 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:32 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5 Jul 31 10:59:32 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Flow 'volume_create_manager' (59cce32a-5906-44c6-818e-c217f56c8faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea4b05d-2f8e-4ccc-ac28-8a8c6e0add93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea4b05d-2f8e-4ccc-ac28-8a8c6e0add93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2058414863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c82282d-e5f5-4c48-8b2b-02a130722c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86fd14e790545198c7fbab58c29e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:32Z,use_quota=True,user_id='e48011acc43c4f9d8084cdfb92421660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b736abb-7f38-4c64-9475-73a6eca9b03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b736abb-7f38-4c64-9475-73a6eca9b03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ef36f8-a1b7-4e1a-8564-72c668d930b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.image.glance [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Creating Keystone auth plugin from conf {{(pid=89145) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:59:32 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5" returned: 0 in 0.400s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:32 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5 Jul 31 10:59:32 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:32 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e" returned: 0 in 0.447s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:32 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e Jul 31 10:59:32 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ef36f8-a1b7-4e1a-8564-72c668d930b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c82282d-e5f5-4c48-8b2b-02a130722c3b', 'volume_name': 'volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b', 'volume_size': 1, 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47167fa6716a45acb0b64b020ce63fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5642f6-bed2-4ccc-87e9-9a701942aae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5642f6-bed2-4ccc-87e9-9a701942aae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac170298-41e0-4aca-8ab5-fc24786b49f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:32 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Volume 2c82282d-e5f5-4c48-8b2b-02a130722c3b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b', 'volume_size': 1, 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47167fa6716a45acb0b64b020ce63fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Trying to clone 2c82282d-e5f5-4c48-8b2b-02a130722c3b from image 73b2b0b0-b476-43bf-9b0b-2363c12be17d at location (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]). {{(pid=89145) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:59:32 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-789fab2c-3ed8-4dac-8067-afe8f2376dc5" returned: 0 in 0.336s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Lock "cinder-quobyte-789fab2c-3ed8-4dac-8067-afe8f2376dc5" released by "delete_volume" :: held 0.817s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:32 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e.941dc701-301b-4371-a7ac-80a19d36462e" returned: 0 in 0.360s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-941dc701-301b-4371-a7ac-80a19d36462e" released by "_delete_snapshot" :: held 1.898s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-eb8c3459-7841-4436-8bdc-f0788719601e" released by "delete_snapshot" :: held 1.941s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Created reservations ['1df2cbe5-6ae6-424d-a76b-d77bc01a56e3', '71f3c2dc-c7f1-488e-8b65-073da5038772', 'c94cf313-18b2-42e7-a299-719efd9098bc', '2eb46dc1-f60c-47e5-9069-d01f4d651cd5'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:59:33 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Image download 20.69 MB at 20.69 MB/s Jul 31 10:59:33 devstack cinder-volume[89145]: WARNING cinder.quota [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-948642282 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-948642282, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:33 devstack cinder-volume[89145]: WARNING cinder.quota [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-948642282 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-948642282, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde3fb32-af6c-4122-bab4-b6b3a4a13573]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:33 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:33 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['fdc3176a-5bd6-42f3-a43d-72ac3c2578db', '611a42f3-8d87-4edb-bdf5-532127bb209f', '5c8327e9-3f85-4b1e-a638-3d149c19bc69', '46079991-465c-4f20-addf-2a6ac9bb1b34'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:33 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD Jul 31 10:59:33 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-145ec87b-c5f7-43a8-81cd-bc0270734ba1 req-bbdeb179-01cf-400f-a6fd-0c095becceab tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-145ec87b-c5f7-43a8-81cd-bc0270734ba1 req-bbdeb179-01cf-400f-a6fd-0c095becceab tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddad1ed-559b-41f4-ba55-9a91a2549984]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-145ec87b-c5f7-43a8-81cd-bc0270734ba1 req-bbdeb179-01cf-400f-a6fd-0c095becceab tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['5a5ff1dd-dcf1-41bd-882d-3a5b01f9f4e3', 'c4db08c7-793c-4621-8303-95c338d0ffc5', '3392237c-0db3-4a8b-9d28-12eca65290d9', 'e38c1814-de5d-46a7-b76d-1e931c79dbb1'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:33 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.315s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:33 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Deleted volume successfully. Jul 31 10:59:33 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126 Jul 31 10:59:33 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:33 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-944a5e80-7b26-4af6-aa67-8385f2753837 tempest-GroupSnapshotsTest-2116496244 None] group_snapshot 4f09966e-7718-4d34-86dd-7b9293c10665: deleted successfully Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0889d28d-c78c-4887-a05b-db6da3ea2c98 tempest-VolumesTransfersV357Test-1855259432 None] Lock "cinder-789fab2c-3ed8-4dac-8067-afe8f2376dc5-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:33 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Temporary image 73b2b0b0-b476-43bf-9b0b-2363c12be17d is fetched for user e48011acc43c4f9d8084cdfb92421660. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[1330dfc5-ec88-4746-92a1-1eaafbb91e84]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:33 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-145ec87b-c5f7-43a8-81cd-bc0270734ba1 req-bbdeb179-01cf-400f-a6fd-0c095becceab tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126" returned: 0 in 0.422s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-145ec87b-c5f7-43a8-81cd-bc0270734ba1 req-bbdeb179-01cf-400f-a6fd-0c095becceab tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.446s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:33 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD Jul 31 10:59:33 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-145ec87b-c5f7-43a8-81cd-bc0270734ba1 req-bbdeb179-01cf-400f-a6fd-0c095becceab tempest-TestInstancesWithCinderVolumes-528178718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-8b717e9f-ad3e-4ac6-aedd-787124de5126', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0641d690-9e96-4598-ad01-0c27198f02e2', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:59:33 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-145ec87b-c5f7-43a8-81cd-bc0270734ba1 req-bbdeb179-01cf-400f-a6fd-0c095becceab tempest-TestInstancesWithCinderVolumes-528178718 None] attachment_update completed successfully. Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-6dd96b94-f0b0-4eb9-89de-5b127c255673" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-6dd96b94-f0b0-4eb9-89de-5b127c255673" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:34 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2058414863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c82282d-e5f5-4c48-8b2b-02a130722c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86fd14e790545198c7fbab58c29e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:32Z,use_quota=True,user_id='e48011acc43c4f9d8084cdfb92421660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Creating volume 2c82282d-e5f5-4c48-8b2b-02a130722c3b {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:34 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda641c6-6769-47e1-82a0-24aa17a96b1b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:34 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b 1073741824 Jul 31 10:59:34 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:34 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 Jul 31 10:59:34 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:34 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673" returned: 0 in 0.478s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:34 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673 Jul 31 10:59:34 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:34 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b 1073741824" returned: 0 in 0.609s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:34 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b Jul 31 10:59:34 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:34 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6dd96b94-f0b0-4eb9-89de-5b127c255673" returned: 0 in 0.331s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-6dd96b94-f0b0-4eb9-89de-5b127c255673" released by "delete_volume" :: held 0.902s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-eb8c3459-7841-4436-8bdc-f0788719601e" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-eb8c3459-7841-4436-8bdc-f0788719601e" acquired by "delete_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Flow 'volume_create_manager' (d8479bfb-b769-45fc-b3f2-f122ecee0ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56eb987-a665-44bc-870a-875a6ef2cc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c18995-df60-4ffa-9a56-726b5b065d82]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56eb987-a665-44bc-870a-875a6ef2cc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1371531633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9c560c-6f08-47ed-862a-6037cde4e0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965924b3dc404ac1864be163cc88d1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:35Z,use_quota=True,user_id='94532a0fcd334b828beadbd4a6553bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:35 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ed9445-11d1-4001-97be-884cff350047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ed9445-11d1-4001-97be-884cff350047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8436cd8-7927-4925-a3b1-3d8351e621d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8436cd8-7927-4925-a3b1-3d8351e621d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e9c560c-6f08-47ed-862a-6037cde4e0d8', 'volume_name': 'volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8765eac2-ce59-4d67-aa8c-53f886ca1e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8765eac2-ce59-4d67-aa8c-53f886ca1e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416210f3-deb9-4c1b-81f9-16da38ef079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:35 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Volume 5e9c560c-6f08-47ed-862a-6037cde4e0d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8', 'volume_size': 1} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b" returned: 0 in 0.342s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1371531633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9c560c-6f08-47ed-862a-6037cde4e0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965924b3dc404ac1864be163cc88d1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:35Z,use_quota=True,user_id='94532a0fcd334b828beadbd4a6553bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Creating volume 5e9c560c-6f08-47ed-862a-6037cde4e0d8 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:35 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:35 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8 1073741824 Jul 31 10:59:35 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Attempting download of 73b2b0b0-b476-43bf-9b0b-2363c12be17d ((None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}])) to volume 2c82282d-e5f5-4c48-8b2b-02a130722c3b. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 10:59:35 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e Jul 31 10:59:35 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9909ff21-9552-4822-b6d8-7d3aa4c8ac32]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_3qz3yqtj {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:35 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_3qz3yqtj Jul 31 10:59:35 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:35 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e" returned: 0 in 0.562s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:35 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e Jul 31 10:59:35 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:35 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_3qz3yqtj" returned: 0 in 0.484s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_3qz3yqtj {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:35 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8 1073741824" returned: 0 in 0.624s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:35 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8 Jul 31 10:59:35 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:35 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_3qz3yqtj Jul 31 10:59:35 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:36 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb8c3459-7841-4436-8bdc-f0788719601e" returned: 0 in 0.443s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-eb8c3459-7841-4436-8bdc-f0788719601e" released by "delete_volume" :: held 1.099s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:36 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8" returned: 0 in 0.353s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:36 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_3qz3yqtj" returned: 1 in 0.433s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_3qz3yqtj' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa62964-8849-4774-878c-d88c9ebeecae]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['354b808a-d6c1-45fd-a13d-1dc2449103d3'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416210f3-deb9-4c1b-81f9-16da38ef079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa06913-560e-4e39-bd91-c4322c7f3dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:36 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Volume volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8 (5e9c560c-6f08-47ed-862a-6037cde4e0d8): created successfully Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa06913-560e-4e39-bd91-c4322c7f3dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Flow 'volume_create_manager' (d8479bfb-b769-45fc-b3f2-f122ecee0ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:36 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f7281c17-91e9-46e1-a80f-5141476bb219 tempest-VolumesTransfersV357Test-379153289 None] Created volume successfully. Jul 31 10:59:36 devstack cinder-volume[89145]: WARNING cinder.quota [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-948642282 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-948642282, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['d1917ab2-5680-4e2b-8c70-bf6d1103e5ab', '2cca60d6-5d50-452a-b23e-601d931d5e3a', 'a0c5a9bb-dc14-4e3f-9762-57b844259dea', '831290c9-e716-49e3-84bc-0718983b49fb'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:36 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD Jul 31 10:59:36 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['57453392-b7d4-4b73-a1e4-5d81db2b989f', '5be395af-f289-473b-9c8a-896f1a3e78f4', 'cac2d936-3b70-427f-89b9-75ac09c1f8f9', '8224ed78-92ef-4185-8fbf-ffb8620dc54b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:36 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:36 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:36 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] 73b2b0b0-b476-43bf-9b0b-2363c12be17d was qcow2, converting to raw {{(pid=89145) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:36 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b Jul 31 10:59:36 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:36 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.331s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:36 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:36 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-38ba0c1f-6b5b-4f9e-96b5-27fd4e692f83 tempest-GroupSnapshotsTest-2116496244 None] Delete group completed successfully. Jul 31 10:59:37 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-bf29818a-c2fb-47d2-93c3-a8a35b88de97 tempest-GroupSnapshotsTest-2116496244 None] Group tempest-GroupSnapshotsTest-Group-608905435: creating Jul 31 10:59:37 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-bf29818a-c2fb-47d2-93c3-a8a35b88de97 tempest-GroupSnapshotsTest-2116496244 None] Group tempest-GroupSnapshotsTest-Group-608905435: created successfully Jul 31 10:59:37 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-bf29818a-c2fb-47d2-93c3-a8a35b88de97 tempest-GroupSnapshotsTest-2116496244 None] Create group completed successfully. Jul 31 10:59:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Acquiring lock "cinder-5e9c560c-6f08-47ed-862a-6037cde4e0d8-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Lock "cinder-5e9c560c-6f08-47ed-862a-6037cde4e0d8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Acquiring lock "cinder-quobyte-5e9c560c-6f08-47ed-862a-6037cde4e0d8" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Lock "cinder-quobyte-5e9c560c-6f08-47ed-862a-6037cde4e0d8" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[494b9839-cf89-4996-a0a9-0411da13fd18]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:37 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8 Jul 31 10:59:37 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:38 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8" returned: 0 in 0.392s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:38 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8 Jul 31 10:59:38 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:38 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e9c560c-6f08-47ed-862a-6037cde4e0d8" returned: 0 in 0.254s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Lock "cinder-quobyte-5e9c560c-6f08-47ed-862a-6037cde4e0d8" released by "delete_volume" :: held 0.696s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:38 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b" returned: 0 in 1.787s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_9fqoep5tdevstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:59:38 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Converted 112.00 MB image at 62.62 MB/s Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Created reservations ['81f3d34f-7094-4d2a-a79b-d64dabd54b49', 'b6e3db5d-2726-4c60-a29c-2acb5ed92b2a', '5de068c0-a10c-4196-9eed-e58d20090281', '86fbf5cf-a6c0-42f2-82ed-16937828c773'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:38 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b 1G Jul 31 10:59:38 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:38 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:38 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:39 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b 1G" returned: 0 in 0.564s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:39 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.460s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eb57a9-0134-41d1-badd-4bebb3cfb606]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Deleted volume successfully. Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Flow 'volume_create_manager' (e5041b90-97ec-4c63-9f59-8e4718116013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44af1b62-77c8-4e4a-b524-2c0d8a3e3229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5d442600-990e-4776-b438-7b3aa9a61562 tempest-VolumesTransfersV357Test-1855259432 None] Lock "cinder-5e9c560c-6f08-47ed-862a-6037cde4e0d8-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44af1b62-77c8-4e4a-b524-2c0d8a3e3229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-778559158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=caa28e11-8be5-4600-ba14-5ce46b3c8be1,host='devstack@QuobyteHD#QuobyteHD',id=91025ba8-d9ff-4601-b2ff-737945dde32e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb6f9dd568a4d1abc71caf0904f3138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:39Z,use_quota=True,user_id='435c53f9c16c4cf5801111dae4b77281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce0bc58f-1594-4a16-ada7-6a2e507d3fe5),volume_type_id=ce0bc58f-1594-4a16-ada7-6a2e507d3fe5)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6701fcca-8afe-4cb5-8c95-e6f2c3c26820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6701fcca-8afe-4cb5-8c95-e6f2c3c26820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c479d3-279f-44ea-92f6-f3d2bd954382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c479d3-279f-44ea-92f6-f3d2bd954382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91025ba8-d9ff-4601-b2ff-737945dde32e', 'volume_name': 'volume-91025ba8-d9ff-4601-b2ff-737945dde32e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7131f837-c113-4627-b749-136783200177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7131f837-c113-4627-b749-136783200177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:39 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b Jul 31 10:59:39 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ba1c41-5e75-4949-9f8a-8f6808c33958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:39 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Volume 91025ba8-d9ff-4601-b2ff-737945dde32e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91025ba8-d9ff-4601-b2ff-737945dde32e', 'volume_size': 1} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=caa28e11-8be5-4600-ba14-5ce46b3c8be1,created_at=2026-07-31T08:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-778559158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=caa28e11-8be5-4600-ba14-5ce46b3c8be1,host='devstack@QuobyteHD#QuobyteHD',id=91025ba8-d9ff-4601-b2ff-737945dde32e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb6f9dd568a4d1abc71caf0904f3138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:39Z,use_quota=True,user_id='435c53f9c16c4cf5801111dae4b77281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce0bc58f-1594-4a16-ada7-6a2e507d3fe5),volume_type_id=ce0bc58f-1594-4a16-ada7-6a2e507d3fe5)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Creating volume 91025ba8-d9ff-4601-b2ff-737945dde32e {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:39 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:39 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e 1073741824 Jul 31 10:59:39 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:39 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b" returned: 0 in 0.509s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:39 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b Jul 31 10:59:39 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:39 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e 1073741824" returned: 0 in 0.567s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:39 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e Jul 31 10:59:39 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:40 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b" returned: 1 in 0.471s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Downloaded image 73b2b0b0-b476-43bf-9b0b-2363c12be17d ((None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}])) to volume 2c82282d-e5f5-4c48-8b2b-02a130722c3b successfully. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Temporary image 73b2b0b0-b476-43bf-9b0b-2363c12be17d for user e48011acc43c4f9d8084cdfb92421660 is deleted. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Marking volume 2c82282d-e5f5-4c48-8b2b-02a130722c3b as bootable. {{(pid=89145) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Copying metadata from image 73b2b0b0-b476-43bf-9b0b-2363c12be17d to 2c82282d-e5f5-4c48-8b2b-02a130722c3b. {{(pid=89145) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Creating volume glance metadata for volume 2c82282d-e5f5-4c48-8b2b-02a130722c3b backed by image 73b2b0b0-b476-43bf-9b0b-2363c12be17d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89145) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac170298-41e0-4aca-8ab5-fc24786b49f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b', 'volume_size': 1, 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47167fa6716a45acb0b64b020ce63fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d36148c-5bd7-4f50-a852-cace8ccd620b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:40 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Volume volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b (2c82282d-e5f5-4c48-8b2b-02a130722c3b): created successfully Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d36148c-5bd7-4f50-a852-cace8ccd620b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Flow 'volume_create_manager' (59cce32a-5906-44c6-818e-c217f56c8faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:40 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e" returned: 0 in 0.324s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ba1c41-5e75-4949-9f8a-8f6808c33958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91025ba8-d9ff-4601-b2ff-737945dde32e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9560efbd-8538-426d-9076-f7c7fe22ba8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:40 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ac9c8bfc-cbc2-451d-9c83-7aa0c54660ad tempest-VolumesExtendTest-1187667837 None] Created volume successfully. Jul 31 10:59:40 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Volume volume-91025ba8-d9ff-4601-b2ff-737945dde32e (91025ba8-d9ff-4601-b2ff-737945dde32e): created successfully Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9560efbd-8538-426d-9076-f7c7fe22ba8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Flow 'volume_create_manager' (e5041b90-97ec-4c63-9f59-8e4718116013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:40 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ca7a6cb0-d002-49f7-a404-d09864c7abeb tempest-GroupSnapshotsTest-2116496244 None] Created volume successfully. Jul 31 10:59:40 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-a64fd937-be7f-4c46-acf2-670e208af998 req-07f6cdb9-842b-45e7-92f1-ef35f937c066 tempest-TestInstancesWithCinderVolumes-528178718 None] Terminate volume connection completed successfully. Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-a64fd937-be7f-4c46-acf2-670e208af998 req-07f6cdb9-842b-45e7-92f1-ef35f937c066 tempest-TestInstancesWithCinderVolumes-528178718 None] Deleting attachment 3bdd718d-e26c-48eb-acc3-8e9e65d727e4. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:59:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "cinder-eb1c331f-4c68-4201-b006-5a23879e1f9f-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "cinder-eb1c331f-4c68-4201-b006-5a23879e1f9f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "cinder-quobyte-eb1c331f-4c68-4201-b006-5a23879e1f9f" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "cinder-quobyte-eb1c331f-4c68-4201-b006-5a23879e1f9f" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[da890ba8-d12c-4905-8bf0-80c27cda7bf1]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-70502dce-faaf-4435-85d2-4779d9171f6a tempest-VolumesExtendTest-1187667837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-70502dce-faaf-4435-85d2-4779d9171f6a tempest-VolumesExtendTest-1187667837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c372beac-d96f-4a84-88f1-be3a42b950d2]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-70502dce-faaf-4435-85d2-4779d9171f6a tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:41 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f Jul 31 10:59:41 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:41 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b Jul 31 10:59:41 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:41 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f" returned: 0 in 0.612s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:41 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f Jul 31 10:59:41 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:41 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-70502dce-faaf-4435-85d2-4779d9171f6a tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b" returned: 0 in 0.499s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-70502dce-faaf-4435-85d2-4779d9171f6a tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] GroupSnapshot e9532cfe-2540-4720-893a-d7e60ff395b3: creating. Jul 31 10:59:42 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b Jul 31 10:59:42 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:42 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] Group snapshot e9532cfe-2540-4720-893a-d7e60ff395b3: creating. {{(pid=89145) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-eb1c331f-4c68-4201-b006-5a23879e1f9f" returned: 0 in 0.375s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "cinder-quobyte-eb1c331f-4c68-4201-b006-5a23879e1f9f" released by "delete_volume" :: held 1.064s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:42 devstack cinder-volume[89145]: WARNING cinder.quota [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1753704884-489626668 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1753704884-489626668, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:42 devstack cinder-volume[89145]: WARNING cinder.quota [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1753704884-489626668 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1753704884-489626668, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Created reservations ['4cd12f5d-d91f-4470-975d-e5fd3d2013cc', '43ed52dc-84f6-49bd-bab1-94e400cf70ef', 'd0686a32-44eb-4bc5-b929-df92781f9899', '1c487531-e628-4a9f-a688-ee6066967b9a'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:42 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:42 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:42 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-70502dce-faaf-4435-85d2-4779d9171f6a tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b" returned: 1 in 0.602s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-70502dce-faaf-4435-85d2-4779d9171f6a tempest-VolumesExtendTest-1187667837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-70502dce-faaf-4435-85d2-4779d9171f6a tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b 2G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-70502dce-faaf-4435-85d2-4779d9171f6a tempest-VolumesExtendTest-1187667837 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b 2G" returned: 0 in 0.090s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-70502dce-faaf-4435-85d2-4779d9171f6a tempest-VolumesExtendTest-1187667837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.269s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.380s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] Creating offline snapshot 33d66989-b89d-4415-b114-a1a3f42f5bd6 of volume 91025ba8-d9ff-4601-b2ff-737945dde32e {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[82302b87-4fa6-4384-ac0c-6827d8490bd2]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-70502dce-faaf-4435-85d2-4779d9171f6a tempest-VolumesExtendTest-1187667837 None] Extend volume completed successfully. Jul 31 10:59:42 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.316s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Deleted volume successfully. Jul 31 10:59:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c21d07a8-d87a-4718-9470-32cd00e2ca74 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "cinder-eb1c331f-4c68-4201-b006-5a23879e1f9f-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:42 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e Jul 31 10:59:42 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:43 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e" returned: 0 in 0.495s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:43 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 1G Jul 31 10:59:43 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:43 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 1G" returned: 0 in 0.611s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91025ba8-d9ff-4601-b2ff-737945dde32e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:43 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91025ba8-d9ff-4601-b2ff-737945dde32e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 Jul 31 10:59:43 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Acquiring lock "cinder-2c82282d-e5f5-4c48-8b2b-02a130722c3b-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Lock "cinder-2c82282d-e5f5-4c48-8b2b-02a130722c3b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Acquiring lock "cinder-quobyte-2c82282d-e5f5-4c48-8b2b-02a130722c3b" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Lock "cinder-quobyte-2c82282d-e5f5-4c48-8b2b-02a130722c3b" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:43 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a8335d-6b06-4064-bf6c-774e86729ef6]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91025ba8-d9ff-4601-b2ff-737945dde32e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6" returned: 0 in 0.412s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:44 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:59:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b Jul 31 10:59:44 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:44 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 Jul 31 10:59:44 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:44 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6" returned: 0 in 0.350s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:44 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b" returned: 0 in 0.493s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.info Jul 31 10:59:44 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:44 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b Jul 31 10:59:44 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:44 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.info" returned: 0 in 0.306s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:44 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:59:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.info Jul 31 10:59:44 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:44 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b" returned: 1 in 0.466s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:59:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b Jul 31 10:59:44 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:45 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.info" returned: 0 in 0.342s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.646s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:45 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2c82282d-e5f5-4c48-8b2b-02a130722c3b" returned: 0 in 0.325s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-08e81e5b-9099-42c9-9b47-3aff10468b9c tempest-GroupSnapshotsTest-2116496244 None] group_snapshot e9532cfe-2540-4720-893a-d7e60ff395b3: created successfully Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Lock "cinder-quobyte-2c82282d-e5f5-4c48-8b2b-02a130722c3b" released by "delete_volume" :: held 1.393s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Created reservations ['70b082ba-0e2c-46bc-a6d9-4196db2da56e', 'bb025509-3eca-4053-8bc6-f517ec141b2e', 'a86debd2-6e10-4ff4-97e6-4ffe7b91bd3d', '45ea27ea-8c52-4335-acbd-2893a37e41b7'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:45 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:45 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] group_snapshot e9532cfe-2540-4720-893a-d7e60ff395b3: deleting Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] group_snapshot e9532cfe-2540-4720-893a-d7e60ff395b3: deleting {{(pid=89145) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-91025ba8-d9ff-4601-b2ff-737945dde32e" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-91025ba8-d9ff-4601-b2ff-737945dde32e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-33d66989-b89d-4415-b114-a1a3f42f5bd6" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-33d66989-b89d-4415-b114-a1a3f42f5bd6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Deleting offline snapshot 33d66989-b89d-4415-b114-a1a3f42f5bd6 of volume 91025ba8-d9ff-4601-b2ff-737945dde32e {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] snapshot_file for this snap is: volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[76403b33-270a-405b-b932-c28cb2d60422]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-e558c484-a124-4c91-aa23-de12bfe4a510 req-7c8f1a5f-8c70-4921-b52a-edf65b8164fa tempest-TestInstancesWithCinderVolumes-528178718 None] Terminate volume connection completed successfully. Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-e558c484-a124-4c91-aa23-de12bfe4a510 req-7c8f1a5f-8c70-4921-b52a-edf65b8164fa tempest-TestInstancesWithCinderVolumes-528178718 None] Deleting attachment 0641d690-9e96-4598-ad01-0c27198f02e2. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:59:45 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.358s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Deleted volume successfully. Jul 31 10:59:45 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 Jul 31 10:59:45 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6239416d-674e-46d2-8e74-0853f97ebdff tempest-VolumesExtendTest-1187667837 None] Lock "cinder-2c82282d-e5f5-4c48-8b2b-02a130722c3b-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:46 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6" returned: 0 in 0.505s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91025ba8-d9ff-4601-b2ff-737945dde32e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b7ae1c-f7a9-4c49-8399-3b35af1dd277]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:46 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e Jul 31 10:59:46 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "cinder-8b717e9f-ad3e-4ac6-aedd-787124de5126-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "cinder-8b717e9f-ad3e-4ac6-aedd-787124de5126-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "cinder-quobyte-8b717e9f-ad3e-4ac6-aedd-787124de5126" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "cinder-quobyte-8b717e9f-ad3e-4ac6-aedd-787124de5126" acquired by "delete_volume" :: waited 0.033s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[79da2446-3d47-4b40-9c6e-69ce2439f31d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:46 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e" returned: 0 in 0.526s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:46 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 Jul 31 10:59:46 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:46 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126 Jul 31 10:59:46 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Flow 'volume_create_manager' (e7ae212c-259e-4e0e-b729-cd543243ecac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccc8ed1-0718-4f44-854f-0cbb9c73318c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccc8ed1-0718-4f44-854f-0cbb9c73318c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-534216676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c658247b-e0df-44fd-a52d-e1a12437b237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86fd14e790545198c7fbab58c29e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:47Z,use_quota=True,user_id='e48011acc43c4f9d8084cdfb92421660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01252e5-b22f-4e28-b52e-8beceecf0d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01252e5-b22f-4e28-b52e-8beceecf0d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e8d51e-4412-42f9-adf1-17bb2961c9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e8d51e-4412-42f9-adf1-17bb2961c9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c658247b-e0df-44fd-a52d-e1a12437b237', 'volume_name': 'volume-c658247b-e0df-44fd-a52d-e1a12437b237', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6387b958-998a-4181-9206-63ef923804c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6387b958-998a-4181-9206-63ef923804c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f5a6a2-7d06-46bf-b788-ad6bffc66a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:47 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Volume c658247b-e0df-44fd-a52d-e1a12437b237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c658247b-e0df-44fd-a52d-e1a12437b237', 'volume_size': 1} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-534216676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c658247b-e0df-44fd-a52d-e1a12437b237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86fd14e790545198c7fbab58c29e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:47Z,use_quota=True,user_id='e48011acc43c4f9d8084cdfb92421660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Creating volume c658247b-e0df-44fd-a52d-e1a12437b237 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:47 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:47 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 1073741824 Jul 31 10:59:47 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Flow 'volume_create_manager' (d93eeb5f-87eb-4af1-bfb0-5be0a7039342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483606f0-e306-427a-9b2a-fd197637503b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483606f0-e306-427a-9b2a-fd197637503b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-27687814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900793d5-17c0-447f-a539-5815dd1b1ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bb9bc14ce846819ceb94ad2d0905e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:47Z,use_quota=True,user_id='90a46bfc007549beb0ad122949a5afc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa7e328-a8e8-41ee-ad5d-b954da2ed061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa7e328-a8e8-41ee-ad5d-b954da2ed061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4094692c-55ce-4233-adf7-221020e3f42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4094692c-55ce-4233-adf7-221020e3f42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '900793d5-17c0-447f-a539-5815dd1b1ed4', 'volume_name': 'volume-900793d5-17c0-447f-a539-5815dd1b1ed4', 'volume_size': 2}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27302c3d-0dc2-40b3-99d2-2e4ef238db14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27302c3d-0dc2-40b3-99d2-2e4ef238db14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba78dd3-dab8-4b58-80d1-25498e6ef83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:47 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Volume 900793d5-17c0-447f-a539-5815dd1b1ed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-900793d5-17c0-447f-a539-5815dd1b1ed4', 'volume_size': 2} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:47 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126" returned: 0 in 0.521s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:47 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126 Jul 31 10:59:47 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:47 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6" returned: 0 in 0.556s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:47 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6 Jul 31 10:59:47 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:47 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8b717e9f-ad3e-4ac6-aedd-787124de5126" returned: 0 in 0.284s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "cinder-quobyte-8b717e9f-ad3e-4ac6-aedd-787124de5126" released by "delete_volume" :: held 0.858s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:47 devstack cinder-volume[89145]: WARNING cinder.quota [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1460235718-109641541 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1460235718-109641541, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:47 devstack cinder-volume[89145]: WARNING cinder.quota [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1460235718-109641541 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1460235718-109641541, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Created reservations ['f787f137-aa2d-4c96-b7b7-1f13f78dbfa8', 'eef43952-9c28-4964-9f49-19dc23702020', 'c42a3f18-a5c3-47ac-bd6d-37f84ee2122b', '17518b80-37f7-4db2-b467-89c72ea63394'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:47 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 1073741824" returned: 0 in 0.587s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:47 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e.33d66989-b89d-4415-b114-a1a3f42f5bd6" returned: 0 in 0.347s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-33d66989-b89d-4415-b114-a1a3f42f5bd6" released by "_delete_snapshot" :: held 2.076s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-91025ba8-d9ff-4601-b2ff-737945dde32e" released by "delete_snapshot" :: held 2.128s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:47 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 Jul 31 10:59:47 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:47 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:47 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:47 devstack cinder-volume[89145]: WARNING cinder.quota [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2125645940 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2125645940, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:47 devstack cinder-volume[89145]: WARNING cinder.quota [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2125645940 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2125645940, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:47 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['2fe7c3fd-67e0-4473-80dd-28dc74bf2202', '5809fa4e-ed22-4e57-8762-c0cd76645954', '8c3d0d20-58e3-427a-8fc8-b2e086b40bed', '36ceac01-a5e1-4baa-a657-d14ee09aa376'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:48 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d1bb5889-8fec-41df-8940-61575402d4ac tempest-GroupSnapshotsTest-2116496244 None] group_snapshot e9532cfe-2540-4720-893a-d7e60ff395b3: deleted successfully Jul 31 10:59:48 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.291s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:48 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Deleted volume successfully. Jul 31 10:59:48 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237" returned: 0 in 0.374s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.901s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-27687814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900793d5-17c0-447f-a539-5815dd1b1ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bb9bc14ce846819ceb94ad2d0905e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:47Z,use_quota=True,user_id='90a46bfc007549beb0ad122949a5afc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Creating volume 900793d5-17c0-447f-a539-5815dd1b1ed4 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:48 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-900793d5-17c0-447f-a539-5815dd1b1ed4 2147483648 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f5a6a2-7d06-46bf-b788-ad6bffc66a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c658247b-e0df-44fd-a52d-e1a12437b237', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:48 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-900793d5-17c0-447f-a539-5815dd1b1ed4 2147483648 Jul 31 10:59:48 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111040a2-3f74-4a14-b4d4-972a027d2b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ee53f12b-1a5c-4ef8-9c19-39e3966f1be9 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "cinder-8b717e9f-ad3e-4ac6-aedd-787124de5126-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:48 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Volume volume-c658247b-e0df-44fd-a52d-e1a12437b237 (c658247b-e0df-44fd-a52d-e1a12437b237): created successfully Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111040a2-3f74-4a14-b4d4-972a027d2b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Flow 'volume_create_manager' (e7ae212c-259e-4e0e-b729-cd543243ecac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:48 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d85dd34c-319f-4ab8-b4f1-dcdc3c33d5b0 tempest-VolumesExtendTest-1187667837 None] Created volume successfully. Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "cinder-quobyte-91025ba8-d9ff-4601-b2ff-737945dde32e" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-91025ba8-d9ff-4601-b2ff-737945dde32e" acquired by "delete_volume" :: waited 0.026s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda55b83-40b2-483e-95d2-d6638cd436cf]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:48 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e Jul 31 10:59:48 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:48 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-900793d5-17c0-447f-a539-5815dd1b1ed4 2147483648" returned: 0 in 0.814s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-900793d5-17c0-447f-a539-5815dd1b1ed4 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:49 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-900793d5-17c0-447f-a539-5815dd1b1ed4 Jul 31 10:59:49 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:49 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e" returned: 0 in 0.739s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:49 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e Jul 31 10:59:49 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:49 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-900793d5-17c0-447f-a539-5815dd1b1ed4" returned: 0 in 0.380s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.134s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] Creating offline snapshot 11f7581a-7b26-4f57-9977-a3f5022fe9ea of volume c658247b-e0df-44fd-a52d-e1a12437b237 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba78dd3-dab8-4b58-80d1-25498e6ef83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-900793d5-17c0-447f-a539-5815dd1b1ed4', 'volume_size': 2}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb9a4bb-6c7f-49d6-a3cc-f9db16362b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2347c7bf-efac-4aa9-9f2a-d4c037105386]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:49 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Volume volume-900793d5-17c0-447f-a539-5815dd1b1ed4 (900793d5-17c0-447f-a539-5815dd1b1ed4): created successfully Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb9a4bb-6c7f-49d6-a3cc-f9db16362b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Flow 'volume_create_manager' (d93eeb5f-87eb-4af1-bfb0-5be0a7039342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:49 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d9cc2dec-93c6-4a22-af47-1f0840450774 tempest-VolumesCloneNegativeTest-721552357 None] Created volume successfully. Jul 31 10:59:49 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 Jul 31 10:59:49 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:49 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-91025ba8-d9ff-4601-b2ff-737945dde32e" returned: 0 in 0.345s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Lock "cinder-quobyte-91025ba8-d9ff-4601-b2ff-737945dde32e" released by "delete_volume" :: held 1.188s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['56c68570-d55a-49e1-b3d4-dc7e5d361c38'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:49 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:49 devstack cinder-volume[89145]: WARNING cinder.quota [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2125645940 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2125645940, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237" returned: 0 in 0.490s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:50 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea 1G Jul 31 10:59:50 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Created reservations ['2b7f45cd-2e20-481b-908c-baac723ab68f', '12445b34-371d-4777-babd-e2b88b31a7ce', '6ce63cf9-481b-463a-8789-f05667ebc2af', 'a739a65b-b3c5-4758-ab62-5dbfa390d07c'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:50 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:50 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Acquiring lock "cinder-900793d5-17c0-447f-a539-5815dd1b1ed4-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Lock "cinder-900793d5-17c0-447f-a539-5815dd1b1ed4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Acquiring lock "cinder-quobyte-900793d5-17c0-447f-a539-5815dd1b1ed4" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Lock "cinder-quobyte-900793d5-17c0-447f-a539-5815dd1b1ed4" acquired by "delete_volume" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:50 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c916fac-db07-4b08-ba84-eb376878c1ea]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.399s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-900793d5-17c0-447f-a539-5815dd1b1ed4 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:50 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8e1ef2dc-8b3a-4f4c-9610-0c94fbfa7f9b tempest-GroupSnapshotsTest-2116496244 None] Delete group completed successfully. Jul 31 10:59:50 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea 1G" returned: 0 in 0.798s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c658247b-e0df-44fd-a52d-e1a12437b237 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:50 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-900793d5-17c0-447f-a539-5815dd1b1ed4 Jul 31 10:59:50 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:50 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c658247b-e0df-44fd-a52d-e1a12437b237 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea Jul 31 10:59:50 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:51 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c658247b-e0df-44fd-a52d-e1a12437b237 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea" returned: 0 in 0.385s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:51 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea is being set with open permissions: ugo+rw Jul 31 10:59:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:51 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea Jul 31 10:59:51 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:51 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-900793d5-17c0-447f-a539-5815dd1b1ed4" returned: 0 in 0.626s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-900793d5-17c0-447f-a539-5815dd1b1ed4 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:51 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-900793d5-17c0-447f-a539-5815dd1b1ed4 Jul 31 10:59:51 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:51 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea" returned: 0 in 0.537s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:51 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-900793d5-17c0-447f-a539-5815dd1b1ed4" returned: 0 in 0.476s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Lock "cinder-quobyte-900793d5-17c0-447f-a539-5815dd1b1ed4" released by "delete_volume" :: held 1.186s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:51 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.info Jul 31 10:59:51 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:51 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Created reservations ['3bfbc6a9-1560-4ec3-8fba-e2a48564d2ab', 'eac27384-2f3b-4e6b-9af7-29b889acb072', '4dfe9cf6-17a9-45aa-936f-33ab320e0d8a', 'eef4feef-47f4-4fc1-a4bc-de4329f6a4a7'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:52 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:52 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:52 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.info" returned: 0 in 0.425s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:52 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.info is being set with open permissions: ugo+rw Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:52 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.info Jul 31 10:59:52 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:52 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.400s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Deleted volume successfully. Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-73425909-d08b-4b12-96a6-acf7846d4643 tempest-VolumesCloneNegativeTest-721552357 None] Lock "cinder-900793d5-17c0-447f-a539-5815dd1b1ed4-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:52 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.info" returned: 0 in 0.508s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.344s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ccd9541f-2914-4232-b676-d17bf6a93be4 tempest-VolumesExtendTest-1187667837 None] Create snapshot completed successfully Jul 31 10:59:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-4131d228-1dca-4eb6-87a8-992ef77d0a77 req-d528770e-46fc-4cea-99d0-9d52f8c283ce tempest-TestInstancesWithCinderVolumes-528178718 None] Terminate volume connection completed successfully. Jul 31 10:59:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-4131d228-1dca-4eb6-87a8-992ef77d0a77 req-d528770e-46fc-4cea-99d0-9d52f8c283ce tempest-TestInstancesWithCinderVolumes-528178718 None] Deleting attachment 85329c4e-30f9-4dc4-ba83-ae0b5ec7d617. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:59:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fa90eb13-9c00-43c8-8267-86642c774122 tempest-VolumesExtendTest-1187667837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fa90eb13-9c00-43c8-8267-86642c774122 tempest-VolumesExtendTest-1187667837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:53 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da628cb-39dd-411d-a14d-e58e6273c8c3]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fa90eb13-9c00-43c8-8267-86642c774122 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:53 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 Jul 31 10:59:53 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:54 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fa90eb13-9c00-43c8-8267-86642c774122 tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237" returned: 0 in 0.534s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fa90eb13-9c00-43c8-8267-86642c774122 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea 2G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fa90eb13-9c00-43c8-8267-86642c774122 tempest-VolumesExtendTest-1187667837 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea 2G" returned: 0 in 0.169s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fa90eb13-9c00-43c8-8267-86642c774122 tempest-VolumesExtendTest-1187667837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.751s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:54 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-fa90eb13-9c00-43c8-8267-86642c774122 tempest-VolumesExtendTest-1187667837 None] Extend volume completed successfully. Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Acquiring lock "cinder-11f7581a-7b26-4f57-9977-a3f5022fe9ea-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Lock "cinder-11f7581a-7b26-4f57-9977-a3f5022fe9ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Acquiring lock "cinder-quobyte-c658247b-e0df-44fd-a52d-e1a12437b237" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Lock "cinder-quobyte-c658247b-e0df-44fd-a52d-e1a12437b237" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Acquiring lock "cinder-quobyte-11f7581a-7b26-4f57-9977-a3f5022fe9ea" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Lock "cinder-quobyte-11f7581a-7b26-4f57-9977-a3f5022fe9ea" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Deleting offline snapshot 11f7581a-7b26-4f57-9977-a3f5022fe9ea of volume c658247b-e0df-44fd-a52d-e1a12437b237 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] snapshot_file for this snap is: volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27a804b-0359-4da3-9ba5-809bc2c32ff0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:55 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea Jul 31 10:59:55 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "cinder-8c46cf78-2e8e-42e7-a5ce-5db691354e50-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "cinder-8c46cf78-2e8e-42e7-a5ce-5db691354e50-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "cinder-quobyte-8c46cf78-2e8e-42e7-a5ce-5db691354e50" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "cinder-quobyte-8c46cf78-2e8e-42e7-a5ce-5db691354e50" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3801774e-8b0b-4fca-a7f4-4e7830598c60]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:55 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea" returned: 0 in 0.523s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c658247b-e0df-44fd-a52d-e1a12437b237(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03a8218-77f0-491c-8f4a-6622c63222b6]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:55 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 Jul 31 10:59:55 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:55 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 Jul 31 10:59:55 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50" returned: 0 in 0.456s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:56 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 Jul 31 10:59:56 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237" returned: 0 in 0.528s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:56 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea Jul 31 10:59:56 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50" returned: 1 in 0.456s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:56 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50 Jul 31 10:59:56 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (c7d6c30f-04d8-4e5e-98e1-36c4d29683af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4baedc-b8ba-4cef-b115-2b49f1a47a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4baedc-b8ba-4cef-b115-2b49f1a47a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-518707048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da5740e-1d4c-489c-a62c-4da35a09ff99,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:57Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:56 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e960445-1cd8-435e-8c88-72597bd52d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e960445-1cd8-435e-8c88-72597bd52d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42088ca9-1396-4bd9-948c-a38ee1d6c686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42088ca9-1396-4bd9-948c-a38ee1d6c686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da5740e-1d4c-489c-a62c-4da35a09ff99', 'volume_name': 'volume-6da5740e-1d4c-489c-a62c-4da35a09ff99', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d33398-6534-45ff-9978-ff3e6688995b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d33398-6534-45ff-9978-ff3e6688995b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d77feab-90be-40db-a57a-937ef17850ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:56 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Volume 6da5740e-1d4c-489c-a62c-4da35a09ff99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da5740e-1d4c-489c-a62c-4da35a09ff99', 'volume_size': 1} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-518707048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da5740e-1d4c-489c-a62c-4da35a09ff99,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:57Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Creating volume 6da5740e-1d4c-489c-a62c-4da35a09ff99 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:56 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6da5740e-1d4c-489c-a62c-4da35a09ff99 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea" returned: 0 in 0.597s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:56 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8c46cf78-2e8e-42e7-a5ce-5db691354e50" returned: 0 in 0.328s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:56 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6da5740e-1d4c-489c-a62c-4da35a09ff99 1073741824 Jul 31 10:59:56 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea Jul 31 10:59:56 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "cinder-quobyte-8c46cf78-2e8e-42e7-a5ce-5db691354e50" released by "delete_volume" :: held 1.339s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:56 devstack cinder-volume[89145]: WARNING cinder.quota [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-855285455-189627029 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-855285455-189627029, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:56 devstack cinder-volume[89145]: WARNING cinder.quota [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-855285455-189627029 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-855285455-189627029, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:56 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Created reservations ['c4063fcd-6a23-4c85-9d7e-fc1fb8403b8d', '3d3a9ca2-058a-4136-998c-5b71455b813c', '1cb34722-d5af-43d2-bd6d-17f74c2c70c1', 'f0b5941a-6026-4b65-8961-39d05edecbb0'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:57 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:57 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:57 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237.11f7581a-7b26-4f57-9977-a3f5022fe9ea" returned: 0 in 0.309s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Lock "cinder-quobyte-11f7581a-7b26-4f57-9977-a3f5022fe9ea" released by "_delete_snapshot" :: held 2.099s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Lock "cinder-quobyte-c658247b-e0df-44fd-a52d-e1a12437b237" released by "delete_snapshot" :: held 2.127s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Created reservations ['83ed589f-51f8-412e-90bd-a3a77f4c6c1c', 'c02129e5-4821-4e03-b444-9ee7dbbddc20', '1bbce41f-c306-4943-b353-8d53e2b91e1c', '7d265a9d-b852-4a08-bd0e-878ce9d5184c'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:57 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:57 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Delete snapshot completed successfully. Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.322s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:57 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Deleted volume successfully. Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8adacc56-52a1-4318-b0b1-bd4ac29a8908 tempest-VolumesExtendTest-1187667837 None] Lock "cinder-11f7581a-7b26-4f57-9977-a3f5022fe9ea-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-64665ba0-2f93-4f65-9aae-b1e04b64a743 tempest-TestInstancesWithCinderVolumes-528178718 None] Lock "cinder-8c46cf78-2e8e-42e7-a5ce-5db691354e50-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:57 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6da5740e-1d4c-489c-a62c-4da35a09ff99 1073741824" returned: 0 in 0.593s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6da5740e-1d4c-489c-a62c-4da35a09ff99 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:57 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6da5740e-1d4c-489c-a62c-4da35a09ff99 Jul 31 10:59:57 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:57 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6da5740e-1d4c-489c-a62c-4da35a09ff99" returned: 0 in 0.282s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d77feab-90be-40db-a57a-937ef17850ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da5740e-1d4c-489c-a62c-4da35a09ff99', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbd0016-2b80-4e0d-8154-1f0cdf57338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:57 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Volume volume-6da5740e-1d4c-489c-a62c-4da35a09ff99 (6da5740e-1d4c-489c-a62c-4da35a09ff99): created successfully Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbd0016-2b80-4e0d-8154-1f0cdf57338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (c7d6c30f-04d8-4e5e-98e1-36c4d29683af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:57 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-46ef29cd-696e-4fb9-bfaf-a04aa8a49ff0 tempest-VolumesGetTest-1619158513 None] Created volume successfully. Jul 31 10:59:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Acquiring lock "cinder-c658247b-e0df-44fd-a52d-e1a12437b237-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Lock "cinder-c658247b-e0df-44fd-a52d-e1a12437b237-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:58 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-224cb148-9342-4409-84d7-47cd27f398a6 tempest-GroupsV320Test-2045781365 None] Group tempest-GroupsV320Test-Group-751250446: creating Jul 31 10:59:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Acquiring lock "cinder-quobyte-c658247b-e0df-44fd-a52d-e1a12437b237" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:58 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-224cb148-9342-4409-84d7-47cd27f398a6 tempest-GroupsV320Test-2045781365 None] Group tempest-GroupsV320Test-Group-751250446: created successfully Jul 31 10:59:58 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-224cb148-9342-4409-84d7-47cd27f398a6 tempest-GroupsV320Test-2045781365 None] Create group completed successfully. Jul 31 10:59:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Lock "cinder-quobyte-c658247b-e0df-44fd-a52d-e1a12437b237" acquired by "delete_volume" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:58 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ab5846-cf23-4ac6-9c5c-f24cbf0913b7]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:58 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 Jul 31 10:59:58 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237" returned: 0 in 0.456s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237 Jul 31 10:59:59 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c658247b-e0df-44fd-a52d-e1a12437b237" returned: 0 in 0.300s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Lock "cinder-quobyte-c658247b-e0df-44fd-a52d-e1a12437b237" released by "delete_volume" :: held 0.829s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Created reservations ['a1610a31-6267-4928-b0f4-362d4279e6b3', '4257d4ec-d8c2-44c4-814f-caae7a6b5c2c', '14c16281-ddbd-4232-8801-eef733f62b19', 'bdaf0866-ce1c-4e57-ad4f-9c7b9f952c30'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (629ec5c1-d721-4c7d-9c44-0ba55ddaf0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ea0ffa-fbe3-497d-a7d3-4793fb408653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ea0ffa-fbe3-497d-a7d3-4793fb408653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-298238168',display_name='tempest-VolumesGetTest-Volume-864569685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a882104-3be2-49ec-981c-e4c958685899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:59Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5782279c-ea69-47bf-89e8-00233f1f2618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5782279c-ea69-47bf-89e8-00233f1f2618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c247f923-3ace-4cb6-9464-ac7c6a2fa25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c247f923-3ace-4cb6-9464-ac7c6a2fa25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a882104-3be2-49ec-981c-e4c958685899', 'volume_name': 'volume-4a882104-3be2-49ec-981c-e4c958685899', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aba6be5-e880-41f2-8b3c-6317ef812291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aba6be5-e880-41f2-8b3c-6317ef812291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6030cbf2-17e9-48cf-af1d-b3c2a1db7b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:59 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Volume 4a882104-3be2-49ec-981c-e4c958685899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a882104-3be2-49ec-981c-e4c958685899', 'volume_size': 1} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-298238168',display_name='tempest-VolumesGetTest-Volume-864569685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a882104-3be2-49ec-981c-e4c958685899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:59Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Creating volume 4a882104-3be2-49ec-981c-e4c958685899 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:59 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4a882104-3be2-49ec-981c-e4c958685899 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4a882104-3be2-49ec-981c-e4c958685899 1073741824 Jul 31 10:59:59 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 10:59:59 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:00 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.428s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:00 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Deleted volume successfully. Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6c1648a7-b24a-4612-b8b2-6cd852839055 tempest-VolumesExtendTest-1187667837 None] Lock "cinder-c658247b-e0df-44fd-a52d-e1a12437b237-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-763208dd-f39f-4de9-993c-10f115634c87 tempest-GroupsV320Test-2045781365 None] Created reservations ['33c463c5-a768-4ae7-a113-a2acb2223597'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-763208dd-f39f-4de9-993c-10f115634c87 tempest-GroupsV320Test-2045781365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-763208dd-f39f-4de9-993c-10f115634c87 tempest-GroupsV320Test-2045781365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-763208dd-f39f-4de9-993c-10f115634c87 tempest-GroupsV320Test-2045781365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-763208dd-f39f-4de9-993c-10f115634c87 tempest-GroupsV320Test-2045781365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-763208dd-f39f-4de9-993c-10f115634c87 tempest-GroupsV320Test-2045781365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-763208dd-f39f-4de9-993c-10f115634c87 tempest-GroupsV320Test-2045781365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:00 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4a882104-3be2-49ec-981c-e4c958685899 1073741824" returned: 0 in 0.850s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:00 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:00:00 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4a882104-3be2-49ec-981c-e4c958685899 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:00 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4a882104-3be2-49ec-981c-e4c958685899 Jul 31 11:00:00 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:00 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-763208dd-f39f-4de9-993c-10f115634c87 tempest-GroupsV320Test-2045781365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.296s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-763208dd-f39f-4de9-993c-10f115634c87 tempest-GroupsV320Test-2045781365 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:00 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-763208dd-f39f-4de9-993c-10f115634c87 tempest-GroupsV320Test-2045781365 None] Delete group completed successfully. Jul 31 11:00:00 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4a882104-3be2-49ec-981c-e4c958685899" returned: 0 in 0.342s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6030cbf2-17e9-48cf-af1d-b3c2a1db7b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a882104-3be2-49ec-981c-e4c958685899', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797d0678-a8b0-4161-a8f7-36f673f0248b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:00 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Volume volume-4a882104-3be2-49ec-981c-e4c958685899 (4a882104-3be2-49ec-981c-e4c958685899): created successfully Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797d0678-a8b0-4161-a8f7-36f673f0248b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (629ec5c1-d721-4c7d-9c44-0ba55ddaf0ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:01 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-479bb0e1-c88b-4283-ad31-66e85ab06ee9 tempest-VolumesGetTest-1619158513 None] Created volume successfully. Jul 31 11:00:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-4a882104-3be2-49ec-981c-e4c958685899-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Lock "cinder-4a882104-3be2-49ec-981c-e4c958685899-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:01 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=213,cinder:INSERT=65,cinder:UPDATE=247,cinder:DELETE=12 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:00:01 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=241,cinder:UPDATE=257,cinder:INSERT=64,cinder:DELETE=16 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:00:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-quobyte-4a882104-3be2-49ec-981c-e4c958685899" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-4a882104-3be2-49ec-981c-e4c958685899" acquired by "delete_volume" :: waited 0.043s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:02 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[190bb0e5-6f68-4f60-bb97-c1d06d1c9cec]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4a882104-3be2-49ec-981c-e4c958685899 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:02 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4a882104-3be2-49ec-981c-e4c958685899 Jul 31 11:00:02 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:02 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4a882104-3be2-49ec-981c-e4c958685899" returned: 0 in 0.545s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4a882104-3be2-49ec-981c-e4c958685899 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:02 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4a882104-3be2-49ec-981c-e4c958685899 Jul 31 11:00:02 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:02 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4a882104-3be2-49ec-981c-e4c958685899" returned: 0 in 0.343s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-4a882104-3be2-49ec-981c-e4c958685899" released by "delete_volume" :: held 0.963s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:03 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Created reservations ['9aee550c-146c-412d-b84e-d60308a804f7', '8e875d42-5911-428a-90d7-a088dd94c5e6', 'f23efe54-b7a9-43ec-a8fe-3606d963b938', '6e1969d7-c51d-4818-9e8b-83d620f50540'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:03 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:00:03 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:03 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.296s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:03 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:03 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Deleted volume successfully. Jul 31 11:00:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-afff2421-a395-41b7-9305-cffed0b0766b tempest-VolumesGetTest-1619158513 None] Lock "cinder-4a882104-3be2-49ec-981c-e4c958685899-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-6da5740e-1d4c-489c-a62c-4da35a09ff99-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Lock "cinder-6da5740e-1d4c-489c-a62c-4da35a09ff99-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-quobyte-6da5740e-1d4c-489c-a62c-4da35a09ff99" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-6da5740e-1d4c-489c-a62c-4da35a09ff99" acquired by "delete_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7125393c-9fc7-45e1-9f93-e66c703742c4]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6da5740e-1d4c-489c-a62c-4da35a09ff99 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Flow 'volume_create_manager' (d56e39e1-fa11-4720-af0b-2d78a1ef3666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220301d4-7ab3-4364-86ae-e5a3f3a2e96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220301d4-7ab3-4364-86ae-e5a3f3a2e96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2054789416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3478a934-d486-450e-acb3-b5b2bdd9b898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d47ee3cea143b2bc82d59dd1e90787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:05Z,use_quota=True,user_id='27778c145bea489bb2087c8e5693d08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d08a8e-55e7-4416-aa94-f62a1a46e25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d08a8e-55e7-4416-aa94-f62a1a46e25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b6694d-64a3-49f0-8b92-76ee44a19b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b6694d-64a3-49f0-8b92-76ee44a19b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3478a934-d486-450e-acb3-b5b2bdd9b898', 'volume_name': 'volume-3478a934-d486-450e-acb3-b5b2bdd9b898', 'volume_size': 2}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e14ebb-8ad7-482a-8bf3-25635477159f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:04 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6da5740e-1d4c-489c-a62c-4da35a09ff99 Jul 31 11:00:04 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e14ebb-8ad7-482a-8bf3-25635477159f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29088b6c-3f79-461d-9f0d-6d442220218d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:04 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Volume 3478a934-d486-450e-acb3-b5b2bdd9b898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3478a934-d486-450e-acb3-b5b2bdd9b898', 'volume_size': 2} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2054789416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3478a934-d486-450e-acb3-b5b2bdd9b898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d47ee3cea143b2bc82d59dd1e90787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:05Z,use_quota=True,user_id='27778c145bea489bb2087c8e5693d08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Creating volume 3478a934-d486-450e-acb3-b5b2bdd9b898 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:04 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:00:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 2147483648 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:04 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 2147483648 Jul 31 11:00:04 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:05 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6da5740e-1d4c-489c-a62c-4da35a09ff99" returned: 0 in 0.502s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6da5740e-1d4c-489c-a62c-4da35a09ff99 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:05 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6da5740e-1d4c-489c-a62c-4da35a09ff99 Jul 31 11:00:05 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:05 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6da5740e-1d4c-489c-a62c-4da35a09ff99" returned: 0 in 0.355s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-6da5740e-1d4c-489c-a62c-4da35a09ff99" released by "delete_volume" :: held 0.926s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:05 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 2147483648" returned: 0 in 0.783s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Created reservations ['572e6484-ab94-419e-b79b-5f92ffbdc21c', 'a2603910-d72f-4855-a0a6-1fcdbc71f29f', '4637f779-c2cc-4577-81eb-2a1ad22072b9', '621f1b7d-39f5-49b0-81d8-61df18232e46'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:05 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 Jul 31 11:00:05 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:05 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:00:05 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:05 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898" returned: 0 in 0.326s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29088b6c-3f79-461d-9f0d-6d442220218d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3478a934-d486-450e-acb3-b5b2bdd9b898', 'volume_size': 2}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7c90d8-d755-4a5b-b56b-ad4664e91f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Volume volume-3478a934-d486-450e-acb3-b5b2bdd9b898 (3478a934-d486-450e-acb3-b5b2bdd9b898): created successfully Jul 31 11:00:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7c90d8-d755-4a5b-b56b-ad4664e91f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:06 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Flow 'volume_create_manager' (d56e39e1-fa11-4720-af0b-2d78a1ef3666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.342s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:06 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:06 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Deleted volume successfully. Jul 31 11:00:06 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-025143b7-5b39-4c0b-836d-ecbc4493d125 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Created volume successfully. Jul 31 11:00:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-06607dc8-5735-431b-a5d9-b64f4a2e1259 tempest-VolumesGetTest-1619158513 None] Lock "cinder-6da5740e-1d4c-489c-a62c-4da35a09ff99-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Creating offline snapshot 413f6923-444f-4693-91c1-c7825f7098ea of volume 3478a934-d486-450e-acb3-b5b2bdd9b898 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a2a502-bc11-400b-b69f-77431d1f1907]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:07 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 Jul 31 11:00:07 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (ab98c329-0533-4150-953b-b81df9d5ca32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97cf017-d59e-4049-8545-e3328d59b2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97cf017-d59e-4049-8545-e3328d59b2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1592772868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe556d1-0c84-417f-b617-9629025aab3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:07Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a96e80-f5c7-4401-a8a9-91d32ed4a7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a96e80-f5c7-4401-a8a9-91d32ed4a7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d091adc9-1421-4e8f-b4b0-708960f0337b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d091adc9-1421-4e8f-b4b0-708960f0337b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe556d1-0c84-417f-b617-9629025aab3d', 'volume_name': 'volume-7fe556d1-0c84-417f-b617-9629025aab3d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b9dd5d-89ba-416b-a16e-1d26d9e8c9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b9dd5d-89ba-416b-a16e-1d26d9e8c9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2b9e51-9a1a-4d64-af20-61c1a3936ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Volume 7fe556d1-0c84-417f-b617-9629025aab3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe556d1-0c84-417f-b617-9629025aab3d', 'volume_size': 1} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:07 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898" returned: 0 in 0.557s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea 2G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:07 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea 2G Jul 31 11:00:07 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:08 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea 2G" returned: 0 in 0.528s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3478a934-d486-450e-acb3-b5b2bdd9b898 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:08 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3478a934-d486-450e-acb3-b5b2bdd9b898 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea Jul 31 11:00:08 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:08 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:00:08 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:08 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.362s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:00:08 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3478a934-d486-450e-acb3-b5b2bdd9b898 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea" returned: 0 in 0.494s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:08 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea is being set with open permissions: ugo+rw Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:08 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea Jul 31 11:00:08 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:08 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea" returned: 0 in 0.295s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:09 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.info Jul 31 11:00:09 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:09 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.info" returned: 0 in 0.313s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:09 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.info is being set with open permissions: ugo+rw Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:09 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.info Jul 31 11:00:09 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:09 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.info" returned: 0 in 0.302s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.620s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.100s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1592772868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe556d1-0c84-417f-b617-9629025aab3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:07Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Creating volume 7fe556d1-0c84-417f-b617-9629025aab3d {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:09 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:00:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:09 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d 1073741824 Jul 31 11:00:09 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:09 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e3acb2e3-7706-485c-ae31-130ce3675ef0 tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Create snapshot completed successfully Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Acquiring lock "cinder-413f6923-444f-4693-91c1-c7825f7098ea-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "cinder-413f6923-444f-4693-91c1-c7825f7098ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Acquiring lock "cinder-quobyte-3478a934-d486-450e-acb3-b5b2bdd9b898" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "cinder-quobyte-3478a934-d486-450e-acb3-b5b2bdd9b898" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Acquiring lock "cinder-quobyte-413f6923-444f-4693-91c1-c7825f7098ea" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "cinder-quobyte-413f6923-444f-4693-91c1-c7825f7098ea" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:10 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Deleting offline snapshot 413f6923-444f-4693-91c1-c7825f7098ea of volume 3478a934-d486-450e-acb3-b5b2bdd9b898 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] snapshot_file for this snap is: volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d 1073741824" returned: 0 in 0.696s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1434a73-da17-4a74-9e76-4b17770536ff]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:10 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d Jul 31 11:00:10 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:10 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea Jul 31 11:00:10 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:10 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d" returned: 0 in 0.449s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2b9e51-9a1a-4d64-af20-61c1a3936ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe556d1-0c84-417f-b617-9629025aab3d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258f9914-1ed0-46c4-b424-74c0805c7d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:10 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Volume volume-7fe556d1-0c84-417f-b617-9629025aab3d (7fe556d1-0c84-417f-b617-9629025aab3d): created successfully Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258f9914-1ed0-46c4-b424-74c0805c7d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (ab98c329-0533-4150-953b-b81df9d5ca32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-096e9f15-65d7-4d6f-b94f-a5a2198e1327 tempest-VolumesGetTest-1619158513 None] Created volume successfully. Jul 31 11:00:11 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea" returned: 0 in 0.644s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3478a934-d486-450e-acb3-b5b2bdd9b898(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:11 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[32822f6f-17dc-48ff-b94a-a7825372d189]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:11 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 Jul 31 11:00:11 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:11 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898" returned: 0 in 0.408s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:11 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea Jul 31 11:00:11 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:11 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea" returned: 0 in 0.464s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:12 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea Jul 31 11:00:12 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:12 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898.413f6923-444f-4693-91c1-c7825f7098ea" returned: 0 in 0.417s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (fa6b3368-3d67-450e-a382-2dbd54d52bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc3efb8-ec6a-40bb-8a6a-29ed138d30f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "cinder-quobyte-413f6923-444f-4693-91c1-c7825f7098ea" released by "_delete_snapshot" :: held 2.132s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc3efb8-ec6a-40bb-8a6a-29ed138d30f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1899930240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7943bda4-f902-451c-a82b-cad1a14068cd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7fe556d1-0c84-417f-b617-9629025aab3d,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:12Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4074066c-454b-4cbe-9042-86efdd52f662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4074066c-454b-4cbe-9042-86efdd52f662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a756237-14f6-4c76-b1cd-0d8f7d68b758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "cinder-quobyte-3478a934-d486-450e-acb3-b5b2bdd9b898" released by "delete_snapshot" :: held 2.187s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a756237-14f6-4c76-b1cd-0d8f7d68b758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7943bda4-f902-451c-a82b-cad1a14068cd', 'volume_name': 'volume-7943bda4-f902-451c-a82b-cad1a14068cd', 'volume_size': 1, 'source_volid': '7fe556d1-0c84-417f-b617-9629025aab3d', 'source_volstatus': 'available'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04429cd4-0001-4c29-bf82-14c1a9e31553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04429cd4-0001-4c29-bf82-14c1a9e31553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26ae356-b684-4bf6-a7f8-6be8e58dab80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:12 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Volume 7943bda4-f902-451c-a82b-cad1a14068cd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7943bda4-f902-451c-a82b-cad1a14068cd', 'volume_size': 1, 'source_volid': '7fe556d1-0c84-417f-b617-9629025aab3d', 'source_volstatus': 'available'} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:12 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Cloning volume 7fe556d1-0c84-417f-b617-9629025aab3d to volume 7943bda4-f902-451c-a82b-cad1a14068cd Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Creating offline snapshot 60e46559-8da4-4f86-88f0-e2fc845f8e03 of volume 7fe556d1-0c84-417f-b617-9629025aab3d {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Created reservations ['883736df-4bc1-4ba7-a457-9b1ea55c3dcc', '1565e640-d66e-4ba6-a880-91d0768cbacf', 'fae63f92-67cc-4ad8-9b21-9285f6ba6ebf', 'ad68b9b6-b549-4aff-8ef3-74afeddb4c30'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[727738f3-07c9-4eaa-948e-41f9fc5794d3]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:12 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Delete snapshot completed successfully. Jul 31 11:00:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61f5e9b6-6688-4b0d-b493-fd64a30085fa tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "cinder-413f6923-444f-4693-91c1-c7825f7098ea-delete_snapshot" released by "delete_snapshot" :: held 2.489s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:12 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d Jul 31 11:00:12 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:13 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d" returned: 0 in 0.482s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:13 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 1G Jul 31 11:00:13 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Acquiring lock "cinder-3478a934-d486-450e-acb3-b5b2bdd9b898-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "cinder-3478a934-d486-450e-acb3-b5b2bdd9b898-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Acquiring lock "cinder-quobyte-3478a934-d486-450e-acb3-b5b2bdd9b898" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "cinder-quobyte-3478a934-d486-450e-acb3-b5b2bdd9b898" acquired by "delete_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:13 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a15a7a-3b6b-4df3-b5cc-8139bf346c4b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:13 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 1G" returned: 0 in 0.637s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe556d1-0c84-417f-b617-9629025aab3d -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:13 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe556d1-0c84-417f-b617-9629025aab3d -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 Jul 31 11:00:13 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:13 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 Jul 31 11:00:13 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:14 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe556d1-0c84-417f-b617-9629025aab3d -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03" returned: 0 in 0.432s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:14 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 is being set with open permissions: ugo+rw Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:14 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 Jul 31 11:00:14 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:14 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898" returned: 0 in 0.546s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:14 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898 Jul 31 11:00:14 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:14 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03" returned: 0 in 0.366s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:14 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.info Jul 31 11:00:14 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:14 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3478a934-d486-450e-acb3-b5b2bdd9b898" returned: 0 in 0.390s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "cinder-quobyte-3478a934-d486-450e-acb3-b5b2bdd9b898" released by "delete_volume" :: held 1.035s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Created reservations ['65bd1dd6-68fb-4396-881a-c1ba4096caf2', '4b9388ba-32d2-4c32-895b-937cd412919a', 'eab141ad-5bdd-43ea-a51f-f14b4bd228a1', 'ae61acc0-959a-4cf9-84ab-7e6a1c291984'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:14 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:00:14 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:15 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.info" returned: 0 in 0.412s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:15 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.info is being set with open permissions: ugo+rw Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:15 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.info Jul 31 11:00:15 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:15 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.313s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:15 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Deleted volume successfully. Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8b90b5b3-32f7-4ddb-8796-3f3a2b61f16a tempest-VolumesSnapshotNegativeTestJSON-1941817382 None] Lock "cinder-3478a934-d486-450e-acb3-b5b2bdd9b898-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:15 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.info" returned: 0 in 0.314s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-quobyte-7943bda4-f902-451c-a82b-cad1a14068cd" by "_copy_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-7943bda4-f902-451c-a82b-cad1a14068cd" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] snapshot: 60e46559-8da4-4f86-88f0-e2fc845f8e03, volume: 7943bda4-f902-451c-a82b-cad1a14068cd, {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b606cd-ae52-49b2-bf0d-416ba9491384]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:15 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 Jul 31 11:00:15 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:15 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03" returned: 0 in 0.456s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fe556d1-0c84-417f-b617-9629025aab3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Creating direct copy from snapshot {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[6157902e-501e-4fcf-b797-3aac79355a04]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:16 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d Jul 31 11:00:16 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:16 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d" returned: 0 in 0.506s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:16 devstack cinder-volume[89145]: DEBUG cinder.utils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Path /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd not found in is_blk_device check {{(pid=89145) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:00:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:16 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd Jul 31 11:00:16 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:18 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Flow 'volume_create_manager' (6f341260-ed15-4127-a134-d85e0b3a23e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfcf2dd-0da7-46e3-88df-d27cce14e0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfcf2dd-0da7-46e3-88df-d27cce14e0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-695556152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d9142a-bbb7-4cea-af30-e97f1db13615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8262540d694838ba6ec656a172344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:18Z,use_quota=True,user_id='c2d52a9b429b4887835fb31959cd952f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1de30e9-646a-4aa3-b880-f7fc0188d1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1de30e9-646a-4aa3-b880-f7fc0188d1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd592931-4a69-4384-9f70-2a1fe340f145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd592931-4a69-4384-9f70-2a1fe340f145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d9142a-bbb7-4cea-af30-e97f1db13615', 'volume_name': 'volume-37d9142a-bbb7-4cea-af30-e97f1db13615', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46e43e1-42b9-4d87-b5a9-2dac809838e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46e43e1-42b9-4d87-b5a9-2dac809838e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab94dc45-9dc9-4130-aa6d-fc6d17647547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:19 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Volume 37d9142a-bbb7-4cea-af30-e97f1db13615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d9142a-bbb7-4cea-af30-e97f1db13615', 'volume_size': 1} Jul 31 11:00:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:22 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd" returned: 0 in 6.083s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:22 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d21a4b-41ae-4da0-bda0-2dc3df3156f0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:22 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d Jul 31 11:00:22 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:23 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d" returned: 0 in 0.584s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:23 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:00:23 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Converted 1024.00 MB image at 168.31 MB/s Jul 31 11:00:23 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd is being set with open permissions: ugo+rw Jul 31 11:00:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:23 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd Jul 31 11:00:23 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:23 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd" returned: 0 in 0.312s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-7943bda4-f902-451c-a82b-cad1a14068cd" released by "_copy_volume_from_snapshot" :: held 8.063s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-quobyte-60e46559-8da4-4f86-88f0-e2fc845f8e03" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-60e46559-8da4-4f86-88f0-e2fc845f8e03" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Deleting offline snapshot 60e46559-8da4-4f86-88f0-e2fc845f8e03 of volume 7fe556d1-0c84-417f-b617-9629025aab3d {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] snapshot_file for this snap is: volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:23 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed00df4-8db7-4b4a-a591-73c4dfe7b365]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:23 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 Jul 31 11:00:23 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:23 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03" returned: 0 in 0.427s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:24 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fe556d1-0c84-417f-b617-9629025aab3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:24 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0664ce-0671-4a07-ac5a-a6a3598c2e41]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:24 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d Jul 31 11:00:24 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:24 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d" returned: 0 in 0.417s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:24 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 Jul 31 11:00:24 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:24 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03" returned: 0 in 0.479s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:24 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03 Jul 31 11:00:24 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:25 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d.60e46559-8da4-4f86-88f0-e2fc845f8e03" returned: 0 in 0.340s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-60e46559-8da4-4f86-88f0-e2fc845f8e03" released by "_delete_snapshot" :: held 1.782s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.782s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.345s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-695556152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d9142a-bbb7-4cea-af30-e97f1db13615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8262540d694838ba6ec656a172344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:18Z,use_quota=True,user_id='c2d52a9b429b4887835fb31959cd952f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Creating volume 37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:25 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26ae356-b684-4bf6-a7f8-6be8e58dab80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7943bda4-f902-451c-a82b-cad1a14068cd', 'volume_size': 1, 'source_volid': '7fe556d1-0c84-417f-b617-9629025aab3d', 'source_volstatus': 'available'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88e127b-4ca0-4dff-96b2-0effb618369c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:25 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 1073741824 Jul 31 11:00:25 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:25 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Volume volume-7943bda4-f902-451c-a82b-cad1a14068cd (7943bda4-f902-451c-a82b-cad1a14068cd): created successfully Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88e127b-4ca0-4dff-96b2-0effb618369c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (fa6b3368-3d67-450e-a382-2dbd54d52bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:25 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-95d36783-3090-4564-a773-4b4e4b2fb564 tempest-VolumesGetTest-1619158513 None] Created volume successfully. Jul 31 11:00:26 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 1073741824" returned: 0 in 0.717s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:26 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 Jul 31 11:00:26 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:26 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615" returned: 0 in 0.351s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab94dc45-9dc9-4130-aa6d-fc6d17647547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d9142a-bbb7-4cea-af30-e97f1db13615', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5456146-b0aa-49cf-9642-5aa3baffe8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Volume volume-37d9142a-bbb7-4cea-af30-e97f1db13615 (37d9142a-bbb7-4cea-af30-e97f1db13615): created successfully Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5456146-b0aa-49cf-9642-5aa3baffe8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Flow 'volume_create_manager' (6f341260-ed15-4127-a134-d85e0b3a23e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:26 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-15b30da9-8194-4b60-813d-c4e1c33560e7 tempest-SnapshotsActionsTest-871412035 None] Created volume successfully. Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (336622e0-d988-47f0-b278-a70f96325796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c67a2a-8187-4d7e-a598-933a958b01ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c67a2a-8187-4d7e-a598-933a958b01ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-399156459',display_name='tempest-VolumesGetTest-Volume-1295516554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1b6ca0-7156-4665-99e6-739c686addf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:27Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3215048b-53e4-4bb7-9bbc-5f2890b47bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3215048b-53e4-4bb7-9bbc-5f2890b47bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bdbd4e-2929-43dc-8bad-852edbf86854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bdbd4e-2929-43dc-8bad-852edbf86854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1b6ca0-7156-4665-99e6-739c686addf9', 'volume_name': 'volume-5f1b6ca0-7156-4665-99e6-739c686addf9', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b42df2-a9e6-4b36-bd16-4b20467e425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b42df2-a9e6-4b36-bd16-4b20467e425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a791f440-d4f6-40fe-a1e2-75a7ed4ce143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Volume 5f1b6ca0-7156-4665-99e6-739c686addf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1b6ca0-7156-4665-99e6-739c686addf9', 'volume_size': 1} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-399156459',display_name='tempest-VolumesGetTest-Volume-1295516554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1b6ca0-7156-4665-99e6-739c686addf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:27Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Creating volume 5f1b6ca0-7156-4665-99e6-739c686addf9 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:26 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:00:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f1b6ca0-7156-4665-99e6-739c686addf9 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:26 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f1b6ca0-7156-4665-99e6-739c686addf9 1073741824 Jul 31 11:00:26 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:27 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f1b6ca0-7156-4665-99e6-739c686addf9 1073741824" returned: 0 in 0.497s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f1b6ca0-7156-4665-99e6-739c686addf9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:27 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f1b6ca0-7156-4665-99e6-739c686addf9 Jul 31 11:00:27 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:27 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f1b6ca0-7156-4665-99e6-739c686addf9" returned: 0 in 0.370s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a791f440-d4f6-40fe-a1e2-75a7ed4ce143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1b6ca0-7156-4665-99e6-739c686addf9', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c9ff56-871f-4f69-8f5c-03a45c59db0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] Creating offline snapshot 99db3498-0216-4fa0-8ea3-404a4d0afc15 of volume 37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:27 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Volume volume-5f1b6ca0-7156-4665-99e6-739c686addf9 (5f1b6ca0-7156-4665-99e6-739c686addf9): created successfully Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c9ff56-871f-4f69-8f5c-03a45c59db0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (336622e0-d988-47f0-b278-a70f96325796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b87fcfc-d5e1-4663-b90e-8d0918dcdad7]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:27 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-fc70e7b0-df4d-43c3-bdbc-df4fcbc62c41 tempest-VolumesGetTest-1619158513 None] Created volume successfully. Jul 31 11:00:28 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 Jul 31 11:00:28 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:28 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615" returned: 0 in 0.422s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:28 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 1G Jul 31 11:00:28 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:28 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 1G" returned: 0 in 0.549s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:28 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:00:28 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-5f1b6ca0-7156-4665-99e6-739c686addf9-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Lock "cinder-5f1b6ca0-7156-4665-99e6-739c686addf9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-quobyte-5f1b6ca0-7156-4665-99e6-739c686addf9" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-5f1b6ca0-7156-4665-99e6-739c686addf9" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:29 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02b12d0-f7e6-44aa-9ec7-98e61ff6b377]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f1b6ca0-7156-4665-99e6-739c686addf9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:29 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.436s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:29 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 is being set with open permissions: ugo+rw Jul 31 11:00:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:29 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:00:29 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:29 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f1b6ca0-7156-4665-99e6-739c686addf9 Jul 31 11:00:29 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:29 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.305s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:29 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.info Jul 31 11:00:29 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:29 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f1b6ca0-7156-4665-99e6-739c686addf9" returned: 0 in 0.513s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f1b6ca0-7156-4665-99e6-739c686addf9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:29 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f1b6ca0-7156-4665-99e6-739c686addf9 Jul 31 11:00:29 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:30 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.info" returned: 0 in 0.385s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:30 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.info is being set with open permissions: ugo+rw Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:30 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.info Jul 31 11:00:30 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:30 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5f1b6ca0-7156-4665-99e6-739c686addf9" returned: 0 in 0.448s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-5f1b6ca0-7156-4665-99e6-739c686addf9" released by "delete_volume" :: held 1.032s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Created reservations ['eebceb6e-fff7-4f79-b1eb-e77be4d70816', '3c83f3f4-d07e-4c44-adcc-04ea13ffc4e3', 'f2ae7c51-8d88-44b8-8d03-5c290842d05e', '6e8f3c51-9481-4c02-9095-7e21e3581e9b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:30 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.info" returned: 0 in 0.334s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.585s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:30 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-229219fb-923d-4be9-9b03-9381220c970f tempest-SnapshotsActionsTest-871412035 None] Create snapshot completed successfully Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:30 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:00:30 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:30 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.397s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:30 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Deleted volume successfully. Jul 31 11:00:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2d4e5bcd-e610-40c4-ad5c-63d70a25f26e tempest-VolumesGetTest-1619158513 None] Lock "cinder-5f1b6ca0-7156-4665-99e6-739c686addf9-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-7943bda4-f902-451c-a82b-cad1a14068cd-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Lock "cinder-7943bda4-f902-451c-a82b-cad1a14068cd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-quobyte-7943bda4-f902-451c-a82b-cad1a14068cd" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-7943bda4-f902-451c-a82b-cad1a14068cd" acquired by "delete_volume" :: waited 0.068s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:31 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4dafcf-a7d5-43e1-81ad-f307827b53a8]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:31 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd Jul 31 11:00:31 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] Creating offline snapshot e9d7206b-e339-4f64-a7cf-9149e5b5e6ed of volume 37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:32 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd" returned: 0 in 0.579s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8177c72f-65e2-40c8-bc00-a09d925e4739]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:32 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd Jul 31 11:00:32 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:32 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:00:32 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:32 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7943bda4-f902-451c-a82b-cad1a14068cd" returned: 0 in 0.417s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-7943bda4-f902-451c-a82b-cad1a14068cd" released by "delete_volume" :: held 1.099s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:32 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.457s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:32 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed 1G Jul 31 11:00:32 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Created reservations ['198b0caf-18f5-44ee-98a7-91daf7b6807c', '41397022-80f7-475e-9e43-6a1a823be8e1', '1b9397eb-dac4-4d02-93b4-5c33ab5711b7', 'd263bb99-dbce-44da-a6e9-16f05dd4b6f5'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:32 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:00:32 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:33 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.360s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:33 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:33 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Deleted volume successfully. Jul 31 11:00:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-53ca723f-1b66-4690-88a8-0b19dd90b6a2 tempest-VolumesGetTest-1619158513 None] Lock "cinder-7943bda4-f902-451c-a82b-cad1a14068cd-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:33 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed 1G" returned: 0 in 0.632s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:33 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed Jul 31 11:00:33 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:33 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed" returned: 0 in 0.391s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:33 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed is being set with open permissions: ugo+rw Jul 31 11:00:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:33 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed Jul 31 11:00:33 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-7fe556d1-0c84-417f-b617-9629025aab3d-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Lock "cinder-7fe556d1-0c84-417f-b617-9629025aab3d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-quobyte-7fe556d1-0c84-417f-b617-9629025aab3d" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-7fe556d1-0c84-417f-b617-9629025aab3d" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:34 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06d1b33-1e4b-49fc-ae8c-d5e4362a0665]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:34 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d Jul 31 11:00:34 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:34 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed" returned: 0 in 0.463s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:34 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-48e683cc-b3e4-4530-93f0-2494a51aea9d tempest-SnapshotsActionsTest-871412035 None] Create snapshot completed successfully Jul 31 11:00:34 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d" returned: 0 in 0.454s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:34 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d Jul 31 11:00:34 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:34 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7fe556d1-0c84-417f-b617-9629025aab3d" returned: 0 in 0.281s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-7fe556d1-0c84-417f-b617-9629025aab3d" released by "delete_volume" :: held 0.825s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:34 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Created reservations ['729e1ee7-7fd7-4b14-a80f-d217b889a691', '968bb42b-6a96-43b0-82e6-1a559ea7d377', '1fdf81b8-2b02-49a9-b457-6ddf160c2ab6', 'bb41b24f-e00c-492d-be03-7324c2a10fa6'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:35 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:00:35 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:35 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.287s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:35 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Deleted volume successfully. Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7552b72d-f954-4e52-89a6-1b4d20410b74 tempest-VolumesGetTest-1619158513 None] Lock "cinder-7fe556d1-0c84-417f-b617-9629025aab3d-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Acquiring lock "cinder-e9d7206b-e339-4f64-a7cf-9149e5b5e6ed-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-e9d7206b-e339-4f64-a7cf-9149e5b5e6ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Acquiring lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Acquiring lock "cinder-quobyte-e9d7206b-e339-4f64-a7cf-9149e5b5e6ed" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-e9d7206b-e339-4f64-a7cf-9149e5b5e6ed" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Deleting offline snapshot e9d7206b-e339-4f64-a7cf-9149e5b5e6ed of volume 37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] snapshot_file for this snap is: volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16e116e-cb16-42d6-ada4-614686523d8e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:35 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed Jul 31 11:00:35 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (e9f2d60b-0151-4ca8-8502-b7b627bb04ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d22bb34-2724-4054-8212-aca3cc749df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:36 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed" returned: 0 in 0.599s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d22bb34-2724-4054-8212-aca3cc749df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1945005617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5aa2ad7-b67e-4ea9-b79b-fe469aab060b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:36Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0992af3-678d-4f48-98ac-d7987575ae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0992af3-678d-4f48-98ac-d7987575ae85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd6e1e5-a50b-4a83-abdf-fb76f1d0c30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG cinder.image.glance [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Creating Keystone auth plugin from conf {{(pid=89145) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[64562766-46b8-4113-9daf-34e2c572ced9]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:36 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:00:36 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:36 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.524s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:36 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed Jul 31 11:00:36 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd6e1e5-a50b-4a83-abdf-fb76f1d0c30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a5aa2ad7-b67e-4ea9-b79b-fe469aab060b', 'volume_name': 'volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b', 'volume_size': 1, 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47167fa6716a45acb0b64b020ce63fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faa5053-204c-470e-9564-added2f10b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faa5053-204c-470e-9564-added2f10b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a3c955-88a2-4567-a348-0acefd599f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:37 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Volume a5aa2ad7-b67e-4ea9-b79b-fe469aab060b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b', 'volume_size': 1, 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47167fa6716a45acb0b64b020ce63fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 11:00:37 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Trying to clone a5aa2ad7-b67e-4ea9-b79b-fe469aab060b from image 73b2b0b0-b476-43bf-9b0b-2363c12be17d at location (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]). {{(pid=89145) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:00:37 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:00:37 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Image download 20.69 MB at 20.69 MB/s Jul 31 11:00:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[687649e2-311b-47f8-b24a-23d1aeb4d42b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:37 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed" returned: 0 in 0.657s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:37 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed Jul 31 11:00:37 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:37 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD Jul 31 11:00:37 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:37 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:37 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Temporary image 73b2b0b0-b476-43bf-9b0b-2363c12be17d is fetched for user 7632cfbf5ca4446391822bc1447e7580. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:00:37 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.e9d7206b-e339-4f64-a7cf-9149e5b5e6ed" returned: 0 in 0.369s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-e9d7206b-e339-4f64-a7cf-9149e5b5e6ed" released by "_delete_snapshot" :: held 2.337s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" released by "delete_snapshot" :: held 2.376s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2a50de-5692-4e1f-89dc-1dfe332d256b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Created reservations ['456fdd92-7f93-477c-abba-7614e88fc7c9', '86293fcf-7524-4d96-9c43-4ac222e55892', '9ae44a0b-d984-4818-a33a-6e90fa13dd0f', 'f0d2386e-a8ae-471b-973c-a1edf2418114'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Delete snapshot completed successfully. Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-96cb58b7-8937-4266-9862-7c31b0d81d6e tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-e9d7206b-e339-4f64-a7cf-9149e5b5e6ed-delete_snapshot" released by "delete_snapshot" :: held 2.590s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:38 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD Jul 31 11:00:38 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:38 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1945005617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5aa2ad7-b67e-4ea9-b79b-fe469aab060b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:36Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Creating volume a5aa2ad7-b67e-4ea9-b79b-fe469aab060b {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:38 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:00:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:38 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b 1073741824 Jul 31 11:00:38 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:39 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b 1073741824" returned: 0 in 0.650s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:39 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b Jul 31 11:00:39 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:39 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b" returned: 0 in 0.359s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.337s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] Creating offline snapshot 96d4532b-3dba-48b6-8e17-5e6919a11888 of volume 37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Attempting download of 73b2b0b0-b476-43bf-9b0b-2363c12be17d ((None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}])) to volume a5aa2ad7-b67e-4ea9-b79b-fe469aab060b. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d50919-c76d-44b3-a762-24757e0878a5]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c68af33-055d-4ad2-b39e-e18f9a9d8cc2]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_h0bl17xi {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:39 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:00:39 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:39 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_h0bl17xi Jul 31 11:00:39 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:40 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_h0bl17xi" returned: 0 in 0.494s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_h0bl17xi {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:40 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.575s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:40 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 1G Jul 31 11:00:40 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:40 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_h0bl17xi Jul 31 11:00:40 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:40 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_h0bl17xi" returned: 1 in 0.525s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_h0bl17xi' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:00:40 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bb0a3d-c4b7-4ca9-903e-9d9c92ba6631]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:40 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 1G" returned: 0 in 0.514s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:40 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 Jul 31 11:00:40 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:40 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD Jul 31 11:00:40 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:41 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888" returned: 0 in 0.350s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:41 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 is being set with open permissions: ugo+rw Jul 31 11:00:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:41 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:41 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] 73b2b0b0-b476-43bf-9b0b-2363c12be17d was qcow2, converting to raw {{(pid=89145) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:00:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:41 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 Jul 31 11:00:41 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:41 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b Jul 31 11:00:41 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:41 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888" returned: 0 in 0.328s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.957s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:41 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6b3c5bd2-c0d6-408c-b220-07f3e59c2909 tempest-SnapshotsActionsTest-871412035 None] Create snapshot completed successfully Jul 31 11:00:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Acquiring lock "cinder-96d4532b-3dba-48b6-8e17-5e6919a11888-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-96d4532b-3dba-48b6-8e17-5e6919a11888-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Acquiring lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Acquiring lock "cinder-quobyte-96d4532b-3dba-48b6-8e17-5e6919a11888" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-96d4532b-3dba-48b6-8e17-5e6919a11888" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Deleting offline snapshot 96d4532b-3dba-48b6-8e17-5e6919a11888 of volume 37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] snapshot_file for this snap is: volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:42 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[5270ee8a-2d03-4f14-b841-e72371bf6894]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:43 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 Jul 31 11:00:43 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:43 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b" returned: 0 in 2.099s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:43 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_rqe_esf_devstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:00:43 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Converted 112.00 MB image at 53.32 MB/s Jul 31 11:00:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:43 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b 1G Jul 31 11:00:43 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:43 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888" returned: 0 in 0.496s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:43 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:43 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deaf8af-366a-48a0-943e-a28107fbc753]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:43 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:00:43 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:43 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b 1G" returned: 0 in 0.368s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:43 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d2a325-9e41-45d0-8de1-c77b56037ec7]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:43 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b Jul 31 11:00:43 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:44 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.642s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:44 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 Jul 31 11:00:44 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:44 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b" returned: 0 in 0.499s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:44 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b Jul 31 11:00:44 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:44 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888" returned: 0 in 0.544s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:44 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888 Jul 31 11:00:44 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:44 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b" returned: 1 in 0.514s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Downloaded image 73b2b0b0-b476-43bf-9b0b-2363c12be17d ((None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}])) to volume a5aa2ad7-b67e-4ea9-b79b-fe469aab060b successfully. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Temporary image 73b2b0b0-b476-43bf-9b0b-2363c12be17d for user 7632cfbf5ca4446391822bc1447e7580 is deleted. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Marking volume a5aa2ad7-b67e-4ea9-b79b-fe469aab060b as bootable. {{(pid=89145) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Copying metadata from image 73b2b0b0-b476-43bf-9b0b-2363c12be17d to a5aa2ad7-b67e-4ea9-b79b-fe469aab060b. {{(pid=89145) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:00:44 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Creating volume glance metadata for volume a5aa2ad7-b67e-4ea9-b79b-fe469aab060b backed by image 73b2b0b0-b476-43bf-9b0b-2363c12be17d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89145) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:00:45 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.96d4532b-3dba-48b6-8e17-5e6919a11888" returned: 0 in 0.386s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a3c955-88a2-4567-a348-0acefd599f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b', 'volume_size': 1, 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47167fa6716a45acb0b64b020ce63fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a36215-3390-4f7e-94f6-c98a92a9d5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-96d4532b-3dba-48b6-8e17-5e6919a11888" released by "_delete_snapshot" :: held 2.230s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:45 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Volume volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b (a5aa2ad7-b67e-4ea9-b79b-fe469aab060b): created successfully Jul 31 11:00:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a36215-3390-4f7e-94f6-c98a92a9d5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (e9f2d60b-0151-4ca8-8502-b7b627bb04ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" released by "delete_snapshot" :: held 2.289s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d08c482c-e0a2-4923-a063-1255c8d30994 tempest-VolumesGetTest-1619158513 None] Created volume successfully. Jul 31 11:00:45 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Created reservations ['3c33cd45-2ed5-4d9b-8739-e8962452467b', '1596b74e-569f-4cc6-b160-8e0f2c5d6eb1', 'a7d5d7a4-30cf-401c-8e3f-3b0953913fe0', 'cd158f24-36ca-448e-b365-1cd46fac0ffa'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Delete snapshot completed successfully. Jul 31 11:00:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-bd94ba2e-d7ea-4094-b24a-00805edfb64c tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-96d4532b-3dba-48b6-8e17-5e6919a11888-delete_snapshot" released by "delete_snapshot" :: held 2.520s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] Creating offline snapshot cbaf91ef-7f52-437a-b5b8-bb223bba3761 of volume 37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d162d2-dcdd-4df5-beab-7d8ec879f2e1]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:46 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:00:46 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:47 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.540s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:47 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 1G Jul 31 11:00:47 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (7007cac6-ed87-47ae-bd68-dcba1c652a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8dac59e-d184-48ed-9b97-d9e8af0d9886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8dac59e-d184-48ed-9b97-d9e8af0d9886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1667980966',display_name='tempest-VolumesGetTest-Volume-2135493475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da2be14-7fba-44c2-ac13-6f2fdb9775c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:47Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093de1f1-b9bc-4b6b-b12d-4583052913d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093de1f1-b9bc-4b6b-b12d-4583052913d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64266670-2f72-4b8f-94de-b333c4f104ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64266670-2f72-4b8f-94de-b333c4f104ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da2be14-7fba-44c2-ac13-6f2fdb9775c3', 'volume_name': 'volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28523e82-251e-45a9-af37-67591e379e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28523e82-251e-45a9-af37-67591e379e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d77a57-03d3-4c41-a43e-4a0f343b34fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:47 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Volume 2da2be14-7fba-44c2-ac13-6f2fdb9775c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3', 'volume_size': 1} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:47 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 1G" returned: 0 in 0.583s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:47 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 Jul 31 11:00:47 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:48 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761" returned: 0 in 0.361s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:48 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 is being set with open permissions: ugo+rw Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:48 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 Jul 31 11:00:48 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:48 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761" returned: 0 in 0.287s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.933s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.015s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1667980966',display_name='tempest-VolumesGetTest-Volume-2135493475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da2be14-7fba-44c2-ac13-6f2fdb9775c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f2cbf3e8fa4458b2060ac682b45605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:47Z,use_quota=True,user_id='7632cfbf5ca4446391822bc1447e7580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Creating volume 2da2be14-7fba-44c2-ac13-6f2fdb9775c3 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:48 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:00:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:48 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3 1073741824 Jul 31 11:00:48 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:48 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-aa038aad-7630-4fba-ad6c-daa0ab360962 tempest-SnapshotsActionsTest-871412035 None] Create snapshot completed successfully Jul 31 11:00:49 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3 1073741824" returned: 0 in 0.535s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:49 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3 Jul 31 11:00:49 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:49 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3" returned: 0 in 0.352s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d77a57-03d3-4c41-a43e-4a0f343b34fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16db0fd2-68bb-4bef-901d-129fec930277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:49 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Volume volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3 (2da2be14-7fba-44c2-ac13-6f2fdb9775c3): created successfully Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16db0fd2-68bb-4bef-901d-129fec930277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Flow 'volume_create_manager' (7007cac6-ed87-47ae-bd68-dcba1c652a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:49 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e3f20b3d-a3a9-4803-9eab-e875f9e6d58b tempest-VolumesGetTest-1619158513 None] Created volume successfully. Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Acquiring lock "cinder-cbaf91ef-7f52-437a-b5b8-bb223bba3761-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-cbaf91ef-7f52-437a-b5b8-bb223bba3761-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Acquiring lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" acquired by "delete_snapshot" :: waited 0.041s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Acquiring lock "cinder-quobyte-cbaf91ef-7f52-437a-b5b8-bb223bba3761" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-cbaf91ef-7f52-437a-b5b8-bb223bba3761" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Deleting offline snapshot cbaf91ef-7f52-437a-b5b8-bb223bba3761 of volume 37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] snapshot_file for this snap is: volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9036541-a901-4d8d-afe0-3a1797244362]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:50 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 Jul 31 11:00:50 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:50 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761" returned: 0 in 0.462s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:50 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c3b79f-e828-4ad8-aa58-1928ab4e8f4e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:50 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:00:50 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-2da2be14-7fba-44c2-ac13-6f2fdb9775c3-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Lock "cinder-2da2be14-7fba-44c2-ac13-6f2fdb9775c3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-quobyte-2da2be14-7fba-44c2-ac13-6f2fdb9775c3" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-2da2be14-7fba-44c2-ac13-6f2fdb9775c3" acquired by "delete_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:51 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced2cdb8-adf7-4d90-8b6f-e747ecac1181]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:51 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.761s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:51 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3 Jul 31 11:00:51 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:51 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 Jul 31 11:00:51 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:51 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3" returned: 0 in 0.826s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:51 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761" returned: 0 in 0.652s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:51 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3 Jul 31 11:00:51 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:51 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761 Jul 31 11:00:51 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:52 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.cbaf91ef-7f52-437a-b5b8-bb223bba3761" returned: 0 in 0.406s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-cbaf91ef-7f52-437a-b5b8-bb223bba3761" released by "_delete_snapshot" :: held 2.466s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" released by "delete_snapshot" :: held 2.504s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:52 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2da2be14-7fba-44c2-ac13-6f2fdb9775c3" returned: 0 in 0.558s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-2da2be14-7fba-44c2-ac13-6f2fdb9775c3" released by "delete_volume" :: held 1.459s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Created reservations ['be84e4bc-ec9b-4561-969e-639509018bab', '551698db-5b4b-4340-8c2b-106f27ef00d5', '5206373f-06f1-4c0f-991f-37b1a6c42b99', 'bbd222ce-5066-4c0d-a4a3-6486c148657b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Created reservations ['321ce905-cc93-4ab0-b9f0-f8f4ee0f41ad', 'd0de49ae-60d8-43b4-8c14-e56de0c19098', 'af7b42c4-c00c-450e-8cef-1a16f12566ec', '54538d8d-2007-454e-a07a-bdc4f5eda5d6'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Delete snapshot completed successfully. Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-044b9f7d-ac48-4649-a429-422514938c68 tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-cbaf91ef-7f52-437a-b5b8-bb223bba3761-delete_snapshot" released by "delete_snapshot" :: held 2.867s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:52 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:00:52 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:53 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.406s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:53 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Deleted volume successfully. Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9ae586d9-923b-41fc-94f4-2273e4ca047f tempest-VolumesGetTest-1619158513 None] Lock "cinder-2da2be14-7fba-44c2-ac13-6f2fdb9775c3-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Lock "cinder-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Acquiring lock "cinder-quobyte-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b" acquired by "delete_volume" :: waited 0.041s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44c392f-b1de-4174-ab2a-4e5dc980ddba]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] Creating offline snapshot 157b8ff1-eb38-416a-8631-9d179d9c685d of volume 37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec68dc5-0528-4f00-a07d-6fdb72fbb1ba]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:53 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b Jul 31 11:00:53 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:54 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:00:54 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:54 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b" returned: 0 in 0.686s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:54 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.599s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:54 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d 1G Jul 31 11:00:54 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:54 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b Jul 31 11:00:54 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:55 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d 1G" returned: 0 in 0.615s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:55 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b" returned: 1 in 0.706s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:00:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:55 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d Jul 31 11:00:55 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:55 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b Jul 31 11:00:55 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:55 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b" returned: 0 in 0.583s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:55 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Lock "cinder-quobyte-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b" released by "delete_volume" :: held 2.123s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d" returned: 0 in 0.661s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:55 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d is being set with open permissions: ugo+rw Jul 31 11:00:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:55 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d Jul 31 11:00:55 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:55 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Created reservations ['3c34a701-42f7-481c-a6da-04d7f6b67870', '98f61690-f2ae-4e59-8a06-92af2566acdf', '27c217f1-87a9-4f29-9987-f3a93034a900', 'da1db62c-0f81-40af-8a4a-daaa93d0e6c1'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:56 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:00:56 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:56 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d" returned: 0 in 0.347s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:56 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-5934ea7f-5b2e-4196-aef8-8c06f1265a4c tempest-SnapshotsActionsTest-871412035 None] Create snapshot completed successfully Jul 31 11:00:56 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.308s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:56 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:56 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Deleted volume successfully. Jul 31 11:00:56 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-28057d56-f6f9-465a-ac8f-fd219ba58abf tempest-VolumesGetTest-1619158513 None] Lock "cinder-a5aa2ad7-b67e-4ea9-b79b-fe469aab060b-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Acquiring lock "cinder-157b8ff1-eb38-416a-8631-9d179d9c685d-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-157b8ff1-eb38-416a-8631-9d179d9c685d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Acquiring lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" acquired by "delete_snapshot" :: waited 0.038s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Acquiring lock "cinder-quobyte-157b8ff1-eb38-416a-8631-9d179d9c685d" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Flow 'volume_create_manager' (a0e33e61-e71e-4d7f-8643-8721a230bfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f3cd11-f9c8-4c4e-b8fa-1c168f97f7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-157b8ff1-eb38-416a-8631-9d179d9c685d" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Deleting offline snapshot 157b8ff1-eb38-416a-8631-9d179d9c685d of volume 37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] snapshot_file for this snap is: volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f3cd11-f9c8-4c4e-b8fa-1c168f97f7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-444556935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a091c131-1a82-47b9-bd2d-2c651a8d6661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdd6da2dea7469189d944716806f0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:57Z,use_quota=True,user_id='0d6cbabcd1b343289014f62c51c15b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bab97e-8b9b-4437-aac8-60872f830fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bab97e-8b9b-4437-aac8-60872f830fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc15e475-9490-497b-ab55-7c85361d717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc15e475-9490-497b-ab55-7c85361d717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a091c131-1a82-47b9-bd2d-2c651a8d6661', 'volume_name': 'volume-a091c131-1a82-47b9-bd2d-2c651a8d6661', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f32fb1-8189-4ee8-b036-a2d5616078d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f32fb1-8189-4ee8-b036-a2d5616078d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce37573-cfd2-439d-8d9f-8f25e8670f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:57 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Volume a091c131-1a82-47b9-bd2d-2c651a8d6661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a091c131-1a82-47b9-bd2d-2c651a8d6661', 'volume_size': 1} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-444556935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a091c131-1a82-47b9-bd2d-2c651a8d6661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdd6da2dea7469189d944716806f0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:57Z,use_quota=True,user_id='0d6cbabcd1b343289014f62c51c15b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Creating volume a091c131-1a82-47b9-bd2d-2c651a8d6661 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:57 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[0959e77f-bffd-4109-a296-da214741b74b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:57 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661 1073741824 Jul 31 11:00:57 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:57 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d Jul 31 11:00:57 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Flow 'volume_create_manager' (41f5ec87-cec5-4d35-b42c-dc3c4aed472d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7c57f9-3cad-4289-85f2-c61144d655cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:58 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d" returned: 0 in 0.739s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7c57f9-3cad-4289-85f2-c61144d655cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1822588032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0aa496-3901-4516-afff-06e4a4dedb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdd6da2dea7469189d944716806f0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:58Z,use_quota=True,user_id='0d6cbabcd1b343289014f62c51c15b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e75aeaa-8d65-49b3-bf4d-f64f7ed48f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e75aeaa-8d65-49b3-bf4d-f64f7ed48f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4aab9d-ba0f-4ef2-8d95-02ca06d300c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4aab9d-ba0f-4ef2-8d95-02ca06d300c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e0aa496-3901-4516-afff-06e4a4dedb1d', 'volume_name': 'volume-5e0aa496-3901-4516-afff-06e4a4dedb1d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153a354d-c2ac-414f-a54d-9d766c3860ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:58 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153a354d-c2ac-414f-a54d-9d766c3860ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c86f732-290a-428d-8082-dcf1e11d01d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:58 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Volume 5e0aa496-3901-4516-afff-06e4a4dedb1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e0aa496-3901-4516-afff-06e4a4dedb1d', 'volume_size': 1} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b706f3a-3a93-4361-a28e-e508ed514bb3]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661 1073741824" returned: 0 in 0.993s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:58 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661 Jul 31 11:00:58 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:58 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:00:58 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:58 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661" returned: 0 in 0.356s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1822588032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0aa496-3901-4516-afff-06e4a4dedb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdd6da2dea7469189d944716806f0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:58Z,use_quota=True,user_id='0d6cbabcd1b343289014f62c51c15b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Creating volume 5e0aa496-3901-4516-afff-06e4a4dedb1d {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:58 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:00:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce37573-cfd2-439d-8d9f-8f25e8670f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a091c131-1a82-47b9-bd2d-2c651a8d6661', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263c0721-9408-4f79-9b9d-b129e87968f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:59 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d 1073741824 Jul 31 11:00:59 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:59 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Volume volume-a091c131-1a82-47b9-bd2d-2c651a8d6661 (a091c131-1a82-47b9-bd2d-2c651a8d6661): created successfully Jul 31 11:00:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263c0721-9408-4f79-9b9d-b129e87968f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Flow 'volume_create_manager' (a0e33e61-e71e-4d7f-8643-8721a230bfbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:59 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2e557fe0-2552-4180-92ce-dd8945bae05f tempest-TestServerVolumeAttachmentScenario-1418350161 None] Created volume successfully. Jul 31 11:00:59 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.802s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:59 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d Jul 31 11:00:59 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:59 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d 1073741824" returned: 0 in 0.898s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:00 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d Jul 31 11:01:00 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:00 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d" returned: 0 in 0.851s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:00 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d Jul 31 11:01:00 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:00 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d" returned: 0 in 0.408s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c86f732-290a-428d-8082-dcf1e11d01d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0aa496-3901-4516-afff-06e4a4dedb1d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9ee20c-b200-4e78-8414-276ef5db6816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:00 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Volume volume-5e0aa496-3901-4516-afff-06e4a4dedb1d (5e0aa496-3901-4516-afff-06e4a4dedb1d): created successfully Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9ee20c-b200-4e78-8414-276ef5db6816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Flow 'volume_create_manager' (41f5ec87-cec5-4d35-b42c-dc3c4aed472d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:00 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-59d55922-5767-4dfc-ad7c-3b9bf0b2bd38 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Created volume successfully. Jul 31 11:01:00 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.157b8ff1-eb38-416a-8631-9d179d9c685d" returned: 0 in 0.468s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-157b8ff1-eb38-416a-8631-9d179d9c685d" released by "_delete_snapshot" :: held 3.264s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" released by "delete_snapshot" :: held 3.332s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Created reservations ['7f8e863b-3e44-46f8-abd9-f2a68a7fc59f', '1765d012-8b8e-438b-a5f5-726d6a3174af', '8ac82c59-9521-49fb-be48-dac4df58ebb8', '571bb32c-6b06-42da-8e0c-e5f947715043'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:00 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Delete snapshot completed successfully. Jul 31 11:01:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3095f161-8988-492a-a127-2dc9cfe71499 tempest-SnapshotsActionsTest-1486963395 None] Lock "cinder-157b8ff1-eb38-416a-8631-9d179d9c685d-delete_snapshot" released by "delete_snapshot" :: held 3.601s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "cinder-99db3498-0216-4fa0-8ea3-404a4d0afc15-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Lock "cinder-99db3498-0216-4fa0-8ea3-404a4d0afc15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "cinder-quobyte-99db3498-0216-4fa0-8ea3-404a4d0afc15" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Lock "cinder-quobyte-99db3498-0216-4fa0-8ea3-404a4d0afc15" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Deleting offline snapshot 99db3498-0216-4fa0-8ea3-404a4d0afc15 of volume 37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:01:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] snapshot_file for this snap is: volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:01:02 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb1cd6a-dd33-44f4-8303-da1e1e15cb59]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:02 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:01:02 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:03 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.728s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d9142a-bbb7-4cea-af30-e97f1db13615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:03 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0b66ef-263e-4209-9e4d-94e366e42f2e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:03 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 Jul 31 11:01:03 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:03 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=104,cinder:INSERT=39,cinder:UPDATE=134,cinder:DELETE=9 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:01:03 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=114,cinder:INSERT=39,cinder:UPDATE=123,cinder:DELETE=14 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Flow 'volume_create_manager' (3f6e954d-fe83-4be2-a9d6-77876a769252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0eaeda-b76a-456c-a957-f7d0b0602911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0eaeda-b76a-456c-a957-f7d0b0602911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-637663373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ca2d25-2644-4106-8f9d-9352fdf29ecc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8df7347e64028999346ba0c247857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:04Z,use_quota=True,user_id='b9ed938d751a487296be0cd30e673015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f49069d-b284-4506-8775-a1d610fdca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f49069d-b284-4506-8775-a1d610fdca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee5c977-c039-4b7e-a74d-88ccf0b7086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee5c977-c039-4b7e-a74d-88ccf0b7086c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47ca2d25-2644-4106-8f9d-9352fdf29ecc', 'volume_name': 'volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da8e2f3-5a9b-4cfe-a88b-45c259b8a923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da8e2f3-5a9b-4cfe-a88b-45c259b8a923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03885b50-60dc-4e1e-954f-9620e48d4fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:04 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Volume 47ca2d25-2644-4106-8f9d-9352fdf29ecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc', 'volume_size': 1} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-637663373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ca2d25-2644-4106-8f9d-9352fdf29ecc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8df7347e64028999346ba0c247857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:04Z,use_quota=True,user_id='b9ed938d751a487296be0cd30e673015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Creating volume 47ca2d25-2644-4106-8f9d-9352fdf29ecc {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:04 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:04 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615" returned: 0 in 0.883s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:04 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc 1073741824 Jul 31 11:01:04 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:04 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:01:04 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:04 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.604s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:04 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15 Jul 31 11:01:04 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:04 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc 1073741824" returned: 0 in 0.755s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:05 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc Jul 31 11:01:05 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Flow 'volume_create_manager' (17a97448-12ac-447a-96e5-a5e75f35e8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b592c29-11b5-47fd-bef6-f1d76bca96ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b592c29-11b5-47fd-bef6-f1d76bca96ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1696309009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2125b91b-ca6d-423f-8fb1-74460d4a9c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c20932cbac4afeb0b330aad01956f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:05Z,use_quota=True,user_id='2c75945cf9ef494e84f18362a125744d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff57cb0c-fbcd-4b9b-9b06-29f3eb304864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff57cb0c-fbcd-4b9b-9b06-29f3eb304864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7ef355-a7a7-405f-a831-4d8fe3258884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7ef355-a7a7-405f-a831-4d8fe3258884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2125b91b-ca6d-423f-8fb1-74460d4a9c19', 'volume_name': 'volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77df0ee7-ecd2-4009-9db2-8ecebd7fcf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77df0ee7-ecd2-4009-9db2-8ecebd7fcf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbceb75f-ae68-4249-9571-63e1117c18cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:05 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Volume 2125b91b-ca6d-423f-8fb1-74460d4a9c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19', 'volume_size': 1} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615.99db3498-0216-4fa0-8ea3-404a4d0afc15" returned: 0 in 0.510s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Lock "cinder-quobyte-99db3498-0216-4fa0-8ea3-404a4d0afc15" released by "_delete_snapshot" :: held 2.969s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" released by "delete_snapshot" :: held 3.020s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:05 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc" returned: 0 in 0.430s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.124s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1696309009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2125b91b-ca6d-423f-8fb1-74460d4a9c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c20932cbac4afeb0b330aad01956f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:05Z,use_quota=True,user_id='2c75945cf9ef494e84f18362a125744d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Creating volume 2125b91b-ca6d-423f-8fb1-74460d4a9c19 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:05 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:05 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19 1073741824 Jul 31 11:01:05 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03885b50-60dc-4e1e-954f-9620e48d4fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42776be7-7dca-44bb-9b22-7cc13d292c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Volume volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc (47ca2d25-2644-4106-8f9d-9352fdf29ecc): created successfully Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42776be7-7dca-44bb-9b22-7cc13d292c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Flow 'volume_create_manager' (3f6e954d-fe83-4be2-a9d6-77876a769252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:05 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-624f0599-1a7e-42ad-9954-d692894091bd tempest-VolumesListTestJSON-551073151 None] Created volume successfully. Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Created reservations ['582404bf-4ef8-4220-9b62-1d3fbcc01c36', '76d2ae31-603b-4989-9fa1-c71a86cff36e', '0b1794f5-6ef5-4598-a007-0b5ba83eafa4', '32ad551d-2172-4b18-b6f2-02ca45caa2a4'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:05 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Delete snapshot completed successfully. Jul 31 11:01:05 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c177a157-1bec-427f-b088-228c47d7c47b tempest-SnapshotsActionsTest-871412035 None] Lock "cinder-99db3498-0216-4fa0-8ea3-404a4d0afc15-delete_snapshot" released by "delete_snapshot" :: held 3.354s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:06 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19 1073741824" returned: 0 in 0.846s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:06 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19 Jul 31 11:01:06 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:06 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19" returned: 0 in 0.439s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbceb75f-ae68-4249-9571-63e1117c18cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7147fe7b-3f7d-4477-94b9-72ff9af375de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:07 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Volume volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19 (2125b91b-ca6d-423f-8fb1-74460d4a9c19): created successfully Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7147fe7b-3f7d-4477-94b9-72ff9af375de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Flow 'volume_create_manager' (17a97448-12ac-447a-96e5-a5e75f35e8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Flow 'volume_create_manager' (0add8c79-9f92-4c16-ac13-7c74a25ab92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1209ada-7299-4495-acc1-66a495f9766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "cinder-37d9142a-bbb7-4cea-af30-e97f1db13615-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:07 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-62be7e7e-8930-46c2-b56d-e8ad58aab72e tempest-TestMinimumBasicScenario-941747030 None] Created volume successfully. Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1209ada-7299-4495-acc1-66a495f9766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1333443629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ea3253-92a8-49db-bf29-eed80d6f4423,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8df7347e64028999346ba0c247857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:07Z,use_quota=True,user_id='b9ed938d751a487296be0cd30e673015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6407a19f-0c41-4382-afaa-61d120ddf831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6407a19f-0c41-4382-afaa-61d120ddf831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a75a7d-c5da-4b46-8a07-80870d180310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a75a7d-c5da-4b46-8a07-80870d180310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ea3253-92a8-49db-bf29-eed80d6f4423', 'volume_name': 'volume-48ea3253-92a8-49db-bf29-eed80d6f4423', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b2453e-598a-441e-bae7-a1dc786ce349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b2453e-598a-441e-bae7-a1dc786ce349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ecb1b5-5470-4439-a9df-4a829ae6a85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:07 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Volume 48ea3253-92a8-49db-bf29-eed80d6f4423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ea3253-92a8-49db-bf29-eed80d6f4423', 'volume_size': 1} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1333443629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ea3253-92a8-49db-bf29-eed80d6f4423,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8df7347e64028999346ba0c247857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:07Z,use_quota=True,user_id='b9ed938d751a487296be0cd30e673015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Creating volume 48ea3253-92a8-49db-bf29-eed80d6f4423 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:07 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-48ea3253-92a8-49db-bf29-eed80d6f4423 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:07 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-48ea3253-92a8-49db-bf29-eed80d6f4423 1073741824 Jul 31 11:01:07 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Lock "cinder-37d9142a-bbb7-4cea-af30-e97f1db13615-delete_volume" acquired by "delete_volume" :: waited 0.174s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" acquired by "delete_volume" :: waited 0.034s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c7b722-7492-4c11-8c76-a0381b479a35]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:07 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 Jul 31 11:01:07 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:08 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-48ea3253-92a8-49db-bf29-eed80d6f4423 1073741824" returned: 0 in 0.901s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-48ea3253-92a8-49db-bf29-eed80d6f4423 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:08 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:01:08 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:08 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615" returned: 0 in 0.877s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:08 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-48ea3253-92a8-49db-bf29-eed80d6f4423 Jul 31 11:01:08 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:08 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615 Jul 31 11:01:08 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:08 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-48ea3253-92a8-49db-bf29-eed80d6f4423" returned: 0 in 0.414s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ecb1b5-5470-4439-a9df-4a829ae6a85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ea3253-92a8-49db-bf29-eed80d6f4423', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12416607-beb1-405f-bc0b-212630fc52e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:08 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:08 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Volume volume-48ea3253-92a8-49db-bf29-eed80d6f4423 (48ea3253-92a8-49db-bf29-eed80d6f4423): created successfully Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12416607-beb1-405f-bc0b-212630fc52e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Flow 'volume_create_manager' (0add8c79-9f92-4c16-ac13-7c74a25ab92b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-37d9142a-bbb7-4cea-af30-e97f1db13615" returned: 0 in 0.443s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Lock "cinder-quobyte-37d9142a-bbb7-4cea-af30-e97f1db13615" released by "delete_volume" :: held 1.469s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:08 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7e35570a-83bb-4746-a2cb-852d1c57505b tempest-VolumesListTestJSON-551073151 None] Created volume successfully. Jul 31 11:01:09 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.765s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Created reservations ['d7a1c9c8-ca6e-4746-b30e-edd8d5c0663f', '5b3bb760-d7d5-490d-b613-de89db13234f', 'ec2a3120-0394-4a42-a3d2-dbc30c740c00', '947f30a9-b281-4143-9e1b-fd3c74697e9f'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:09 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:01:09 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:09 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.393s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:09 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Deleted volume successfully. Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-a1184701-d956-4106-a3e2-8e7fe5c9b3d7 req-d2ba3ac5-005b-491e-9f3d-3b82405ca20e tempest-TestMinimumBasicScenario-941747030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-a1184701-d956-4106-a3e2-8e7fe5c9b3d7 req-d2ba3ac5-005b-491e-9f3d-3b82405ca20e tempest-TestMinimumBasicScenario-941747030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-191a61a7-e923-475e-867f-1e5c8def6042 tempest-SnapshotsActionsTest-871412035 None] Lock "cinder-37d9142a-bbb7-4cea-af30-e97f1db13615-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9419dff3-9b9c-424e-a4ba-f9954e90aaf3]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-a1184701-d956-4106-a3e2-8e7fe5c9b3d7 req-d2ba3ac5-005b-491e-9f3d-3b82405ca20e tempest-TestMinimumBasicScenario-941747030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:09 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19 Jul 31 11:01:09 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Flow 'volume_create_manager' (38163170-60d9-4179-bda9-f0da98571650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd15d52-44f8-4a02-8e6a-c831e7ca313a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd15d52-44f8-4a02-8e6a-c831e7ca313a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-484139872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7600469-0705-4587-b0dd-a9884879bdbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8df7347e64028999346ba0c247857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:10Z,use_quota=True,user_id='b9ed938d751a487296be0cd30e673015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb64b4d-68be-4221-b1b9-03e0299dcd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb64b4d-68be-4221-b1b9-03e0299dcd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3477544d-eb71-410a-b9b6-648c04f0ae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3477544d-eb71-410a-b9b6-648c04f0ae5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7600469-0705-4587-b0dd-a9884879bdbf', 'volume_name': 'volume-e7600469-0705-4587-b0dd-a9884879bdbf', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4767304-649c-46e4-b78a-2541018f3943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4767304-649c-46e4-b78a-2541018f3943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e338bbb6-f8f4-4d86-8d98-483aa72a2b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:10 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Volume e7600469-0705-4587-b0dd-a9884879bdbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7600469-0705-4587-b0dd-a9884879bdbf', 'volume_size': 1} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:10 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-a1184701-d956-4106-a3e2-8e7fe5c9b3d7 req-d2ba3ac5-005b-491e-9f3d-3b82405ca20e tempest-TestMinimumBasicScenario-941747030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19" returned: 0 in 0.845s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-a1184701-d956-4106-a3e2-8e7fe5c9b3d7 req-d2ba3ac5-005b-491e-9f3d-3b82405ca20e tempest-TestMinimumBasicScenario-941747030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.905s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-484139872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7600469-0705-4587-b0dd-a9884879bdbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8df7347e64028999346ba0c247857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:10Z,use_quota=True,user_id='b9ed938d751a487296be0cd30e673015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Creating volume e7600469-0705-4587-b0dd-a9884879bdbf {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:10 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e7600469-0705-4587-b0dd-a9884879bdbf 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:10 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e7600469-0705-4587-b0dd-a9884879bdbf 1073741824 Jul 31 11:01:10 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-a1184701-d956-4106-a3e2-8e7fe5c9b3d7 req-d2ba3ac5-005b-491e-9f3d-3b82405ca20e tempest-TestMinimumBasicScenario-941747030 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c031be15-c90e-48aa-85e2-1c2b90be39ce', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:01:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-a1184701-d956-4106-a3e2-8e7fe5c9b3d7 req-d2ba3ac5-005b-491e-9f3d-3b82405ca20e tempest-TestMinimumBasicScenario-941747030 None] attachment_update completed successfully. Jul 31 11:01:11 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e7600469-0705-4587-b0dd-a9884879bdbf 1073741824" returned: 0 in 0.907s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e7600469-0705-4587-b0dd-a9884879bdbf {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:11 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e7600469-0705-4587-b0dd-a9884879bdbf Jul 31 11:01:11 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:11 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e7600469-0705-4587-b0dd-a9884879bdbf" returned: 0 in 0.444s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e338bbb6-f8f4-4d86-8d98-483aa72a2b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7600469-0705-4587-b0dd-a9884879bdbf', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe394ae-846e-4dc6-b451-c05426092eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:12 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Volume volume-e7600469-0705-4587-b0dd-a9884879bdbf (e7600469-0705-4587-b0dd-a9884879bdbf): created successfully Jul 31 11:01:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe394ae-846e-4dc6-b451-c05426092eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Flow 'volume_create_manager' (38163170-60d9-4179-bda9-f0da98571650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:12 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a52ed993-ab2e-4f85-aabb-8b40676e9c6b tempest-VolumesListTestJSON-551073151 None] Created volume successfully. Jul 31 11:01:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Acquiring lock "cinder-e7600469-0705-4587-b0dd-a9884879bdbf-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Lock "cinder-e7600469-0705-4587-b0dd-a9884879bdbf-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Acquiring lock "cinder-quobyte-e7600469-0705-4587-b0dd-a9884879bdbf" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Lock "cinder-quobyte-e7600469-0705-4587-b0dd-a9884879bdbf" acquired by "delete_volume" :: waited 0.036s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:18 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa17dd3a-63e5-484d-a182-6e687f1d74fa]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e7600469-0705-4587-b0dd-a9884879bdbf {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:18 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e7600469-0705-4587-b0dd-a9884879bdbf Jul 31 11:01:18 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:18 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e7600469-0705-4587-b0dd-a9884879bdbf" returned: 0 in 0.457s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e7600469-0705-4587-b0dd-a9884879bdbf {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:18 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e7600469-0705-4587-b0dd-a9884879bdbf Jul 31 11:01:18 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:19 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e7600469-0705-4587-b0dd-a9884879bdbf" returned: 0 in 0.544s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:19 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Lock "cinder-quobyte-e7600469-0705-4587-b0dd-a9884879bdbf" released by "delete_volume" :: held 1.096s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:19 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Created reservations ['8d986d28-4fda-4184-81b6-1b6cd168d638', '71e2aee5-1799-4e5d-bc55-e6d5e33465a6', '06314467-59d4-4986-85b7-ddea27716f59', '903425f0-a8d2-4a97-8743-c7de53eb2702'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:19 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:01:19 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:20 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.528s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:20 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:20 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Deleted volume successfully. Jul 31 11:01:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6d8b4e49-18f0-4858-830c-093fd0e89606 tempest-VolumesListTestJSON-551073151 None] Lock "cinder-e7600469-0705-4587-b0dd-a9884879bdbf-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Acquiring lock "cinder-48ea3253-92a8-49db-bf29-eed80d6f4423-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Lock "cinder-48ea3253-92a8-49db-bf29-eed80d6f4423-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Acquiring lock "cinder-quobyte-48ea3253-92a8-49db-bf29-eed80d6f4423" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Lock "cinder-quobyte-48ea3253-92a8-49db-bf29-eed80d6f4423" acquired by "delete_volume" :: waited 0.032s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:20 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce50c21-02c2-4d74-a370-7996f21124f2]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-48ea3253-92a8-49db-bf29-eed80d6f4423 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:20 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-48ea3253-92a8-49db-bf29-eed80d6f4423 Jul 31 11:01:20 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:21 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-48ea3253-92a8-49db-bf29-eed80d6f4423" returned: 0 in 0.537s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-48ea3253-92a8-49db-bf29-eed80d6f4423 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:21 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-48ea3253-92a8-49db-bf29-eed80d6f4423 Jul 31 11:01:21 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:21 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-48ea3253-92a8-49db-bf29-eed80d6f4423" returned: 0 in 0.387s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Lock "cinder-quobyte-48ea3253-92a8-49db-bf29-eed80d6f4423" released by "delete_volume" :: held 0.990s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:21 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Created reservations ['529d3234-807c-4704-93e8-b3e946be6a46', 'f7398791-6d8f-434e-b520-f39026d602af', 'f3b84755-2ea3-48bf-8e00-984f5667ed30', '09cdf7ae-d325-43f1-a4a5-92c90b562684'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:22 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:01:22 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:22 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.384s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:22 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:22 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Deleted volume successfully. Jul 31 11:01:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-61148eaf-95c8-4310-baf5-9c0fe95a4e63 tempest-VolumesListTestJSON-551073151 None] Lock "cinder-48ea3253-92a8-49db-bf29-eed80d6f4423-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Acquiring lock "cinder-47ca2d25-2644-4106-8f9d-9352fdf29ecc-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Lock "cinder-47ca2d25-2644-4106-8f9d-9352fdf29ecc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Acquiring lock "cinder-quobyte-47ca2d25-2644-4106-8f9d-9352fdf29ecc" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Lock "cinder-quobyte-47ca2d25-2644-4106-8f9d-9352fdf29ecc" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:23 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b9260f-8461-4b3b-ab17-65a42650e9ca]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:23 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc Jul 31 11:01:23 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:23 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc" returned: 0 in 0.483s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:23 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc Jul 31 11:01:23 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:23 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-47ca2d25-2644-4106-8f9d-9352fdf29ecc" returned: 0 in 0.314s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Lock "cinder-quobyte-47ca2d25-2644-4106-8f9d-9352fdf29ecc" released by "delete_volume" :: held 0.860s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:24 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Created reservations ['e2f54ef6-6a7c-46ba-ba51-91be300b756c', 'c844bd74-3233-427c-9676-be00d6578d4a', '258b58a3-b957-440c-bc53-0c048ea76c50', '2d492436-94b6-435d-b433-9ea95b443b8c'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:24 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:24 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:24 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:01:24 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:24 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.540s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:24 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:24 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Deleted volume successfully. Jul 31 11:01:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22ae72fa-8863-45a0-b245-dd4167c667f7 tempest-VolumesListTestJSON-551073151 None] Lock "cinder-47ca2d25-2644-4106-8f9d-9352fdf29ecc-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:34 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=40,cinder:UPDATE=51,cinder:INSERT=12,cinder:DELETE=2 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:01:34 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=51,cinder:INSERT=12,cinder:SELECT=38,cinder:DELETE=6 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Flow 'volume_create_manager' (69c5abce-72c2-4544-a692-8f4e8b27b8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0846afb8-e47c-4eed-b487-a475057f9fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0846afb8-e47c-4eed-b487-a475057f9fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1719593719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728062d0-a365-46a9-b0d8-519522436cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485b3a964a6d4a118e98b8023a21dcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:39Z,use_quota=True,user_id='68e5971f849945768f7015e7eed0044f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8661b3b-08d2-46b3-b995-59f11d9c1f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8661b3b-08d2-46b3-b995-59f11d9c1f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7440aa56-ce67-43d3-acf4-a6b7c0a7c78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7440aa56-ce67-43d3-acf4-a6b7c0a7c78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '728062d0-a365-46a9-b0d8-519522436cf5', 'volume_name': 'volume-728062d0-a365-46a9-b0d8-519522436cf5', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45630a2-113b-4add-81ef-642e34672be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45630a2-113b-4add-81ef-642e34672be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1b4dab-4f74-42c3-9897-1fafa6b31539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:39 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Volume 728062d0-a365-46a9-b0d8-519522436cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-728062d0-a365-46a9-b0d8-519522436cf5', 'volume_size': 1} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1719593719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728062d0-a365-46a9-b0d8-519522436cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485b3a964a6d4a118e98b8023a21dcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:39Z,use_quota=True,user_id='68e5971f849945768f7015e7eed0044f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Creating volume 728062d0-a365-46a9-b0d8-519522436cf5 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:39 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:39 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 1073741824 Jul 31 11:01:39 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:39 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 1073741824" returned: 0 in 0.410s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:39 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 Jul 31 11:01:39 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:39 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5" returned: 0 in 0.229s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1b4dab-4f74-42c3-9897-1fafa6b31539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-728062d0-a365-46a9-b0d8-519522436cf5', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbeb3aa9-9a4f-47c3-95cd-61146d031f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:39 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Volume volume-728062d0-a365-46a9-b0d8-519522436cf5 (728062d0-a365-46a9-b0d8-519522436cf5): created successfully Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbeb3aa9-9a4f-47c3-95cd-61146d031f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Flow 'volume_create_manager' (69c5abce-72c2-4544-a692-8f4e8b27b8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-636c14e4-a908-4987-b511-85f6cc6e785a tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Created volume successfully. Jul 31 11:01:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Creating offline snapshot b3107daf-1387-4981-8133-eb1cdcd35783 of volume 728062d0-a365-46a9-b0d8-519522436cf5 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:01:40 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd8b93b-de24-47e4-b6a4-3f47a026a094]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:40 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 Jul 31 11:01:40 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:40 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5" returned: 0 in 0.370s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:40 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 1G Jul 31 11:01:40 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:41 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 1G" returned: 0 in 0.443s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-728062d0-a365-46a9-b0d8-519522436cf5 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:41 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-728062d0-a365-46a9-b0d8-519522436cf5 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 Jul 31 11:01:41 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:41 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-728062d0-a365-46a9-b0d8-519522436cf5 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783" returned: 0 in 0.337s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:41 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 is being set with open permissions: ugo+rw Jul 31 11:01:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:41 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 Jul 31 11:01:41 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-0c09978a-ba04-42d3-8a7b-ba9befbb050e req-31ffa2f3-e252-4224-abb8-7923af6f2223 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:41 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783" returned: 0 in 0.251s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:41 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.info Jul 31 11:01:41 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:41 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.info" returned: 0 in 0.255s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:41 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.info is being set with open permissions: ugo+rw Jul 31 11:01:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:42 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.info Jul 31 11:01:42 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:42 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.info" returned: 0 in 0.260s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-0c09978a-ba04-42d3-8a7b-ba9befbb050e req-31ffa2f3-e252-4224-abb8-7923af6f2223 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.628s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:42 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[292102dc-a434-4790-936e-4c699987a908]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-0c09978a-ba04-42d3-8a7b-ba9befbb050e req-31ffa2f3-e252-4224-abb8-7923af6f2223 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9258cacc-2d26-4942-afbf-5b16b185c4fd tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Create snapshot completed successfully Jul 31 11:01:42 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661 Jul 31 11:01:42 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:42 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-0c09978a-ba04-42d3-8a7b-ba9befbb050e req-31ffa2f3-e252-4224-abb8-7923af6f2223 tempest-TestServerVolumeAttachmentScenario-1418350161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661" returned: 0 in 0.379s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-0c09978a-ba04-42d3-8a7b-ba9befbb050e req-31ffa2f3-e252-4224-abb8-7923af6f2223 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.407s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-0c09978a-ba04-42d3-8a7b-ba9befbb050e req-31ffa2f3-e252-4224-abb8-7923af6f2223 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-a091c131-1a82-47b9-bd2d-2c651a8d6661', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a1bbd2d-4abb-4f2a-9b68-02f177af3606', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:01:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-0c09978a-ba04-42d3-8a7b-ba9befbb050e req-31ffa2f3-e252-4224-abb8-7923af6f2223 tempest-TestServerVolumeAttachmentScenario-1418350161 None] attachment_update completed successfully. Jul 31 11:01:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Acquiring lock "cinder-b3107daf-1387-4981-8133-eb1cdcd35783-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "cinder-b3107daf-1387-4981-8133-eb1cdcd35783-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Acquiring lock "cinder-quobyte-728062d0-a365-46a9-b0d8-519522436cf5" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "cinder-quobyte-728062d0-a365-46a9-b0d8-519522436cf5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Acquiring lock "cinder-quobyte-b3107daf-1387-4981-8133-eb1cdcd35783" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "cinder-quobyte-b3107daf-1387-4981-8133-eb1cdcd35783" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Deleting offline snapshot b3107daf-1387-4981-8133-eb1cdcd35783 of volume 728062d0-a365-46a9-b0d8-519522436cf5 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] snapshot_file for this snap is: volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83e934e-1c2b-4446-b614-83962e1283e6]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:44 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 Jul 31 11:01:44 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:44 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783" returned: 0 in 0.435s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-728062d0-a365-46a9-b0d8-519522436cf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da2022e-6586-4be8-b93b-ae701776a3f2]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:44 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 Jul 31 11:01:44 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:45 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5" returned: 0 in 0.448s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:45 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 Jul 31 11:01:45 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:45 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783" returned: 0 in 0.412s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:45 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783 Jul 31 11:01:45 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:45 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5.b3107daf-1387-4981-8133-eb1cdcd35783" returned: 0 in 0.267s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "cinder-quobyte-b3107daf-1387-4981-8133-eb1cdcd35783" released by "_delete_snapshot" :: held 1.689s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "cinder-quobyte-728062d0-a365-46a9-b0d8-519522436cf5" released by "delete_snapshot" :: held 1.721s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:45 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Created reservations ['5f6f6654-ff8f-45ce-bbb1-ecac20ad3c83', 'c22a5e9a-006d-4582-b704-5fe260443757', 'ebae6195-ebf4-4768-b37a-b254e8206da7', '4b09d4be-b6ba-4112-8973-3860702a30cb'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Delete snapshot completed successfully. Jul 31 11:01:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3c0bd784-e4e6-4814-85a4-3fa9c076e2b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "cinder-b3107daf-1387-4981-8133-eb1cdcd35783-delete_snapshot" released by "delete_snapshot" :: held 1.907s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Acquiring lock "cinder-728062d0-a365-46a9-b0d8-519522436cf5-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "cinder-728062d0-a365-46a9-b0d8-519522436cf5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Acquiring lock "cinder-quobyte-728062d0-a365-46a9-b0d8-519522436cf5" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "cinder-quobyte-728062d0-a365-46a9-b0d8-519522436cf5" acquired by "delete_volume" :: waited 0.031s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e4cd02-d171-4058-bc29-6efea66b4080]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:46 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 Jul 31 11:01:46 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:46 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5" returned: 0 in 0.432s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:46 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5 Jul 31 11:01:46 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-81daaf25-4d41-49bb-aafa-19564cbd72fd req-68c559f6-cb5d-4820-9b2f-57853b903b46 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-81daaf25-4d41-49bb-aafa-19564cbd72fd req-68c559f6-cb5d-4820-9b2f-57853b903b46 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db46a84-85c4-497e-8614-e000bd55aea5]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-81daaf25-4d41-49bb-aafa-19564cbd72fd req-68c559f6-cb5d-4820-9b2f-57853b903b46 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:47 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d Jul 31 11:01:47 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:47 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-728062d0-a365-46a9-b0d8-519522436cf5" returned: 0 in 0.269s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "cinder-quobyte-728062d0-a365-46a9-b0d8-519522436cf5" released by "delete_volume" :: held 0.781s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Created reservations ['21c3dd9c-3b95-4013-8536-bf228ce15343', '033d1bae-9862-48d6-9554-875744e0dc28', '321a5761-6ba5-4354-b22a-23d5a893c103', 'b85c6dc5-7107-4d98-a5c5-a4e224f9f168'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:47 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:01:47 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:47 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-81daaf25-4d41-49bb-aafa-19564cbd72fd req-68c559f6-cb5d-4820-9b2f-57853b903b46 tempest-TestServerVolumeAttachmentScenario-1418350161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d" returned: 0 in 0.403s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-81daaf25-4d41-49bb-aafa-19564cbd72fd req-68c559f6-cb5d-4820-9b2f-57853b903b46 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.422s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-81daaf25-4d41-49bb-aafa-19564cbd72fd req-68c559f6-cb5d-4820-9b2f-57853b903b46 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-5e0aa496-3901-4516-afff-06e4a4dedb1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f42b901-6f7d-486d-b5e2-8de28f692d27', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:01:47 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-81daaf25-4d41-49bb-aafa-19564cbd72fd req-68c559f6-cb5d-4820-9b2f-57853b903b46 tempest-TestServerVolumeAttachmentScenario-1418350161 None] attachment_update completed successfully. Jul 31 11:01:47 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.366s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:47 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Deleted volume successfully. Jul 31 11:01:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4400de6b-3877-47ef-9402-8181347e2896 tempest-VolumeSnapshotQuotasNegativeTestJSON-989771124 None] Lock "cinder-728062d0-a365-46a9-b0d8-519522436cf5-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:49 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-dedef0e1-6b22-47d8-b142-054d24c831a9 req-f67bacd1-b36a-405f-8e59-d3abf3242f11 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Terminate volume connection completed successfully. Jul 31 11:01:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-dedef0e1-6b22-47d8-b142-054d24c831a9 req-f67bacd1-b36a-405f-8e59-d3abf3242f11 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Deleting attachment 7f42b901-6f7d-486d-b5e2-8de28f692d27. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:01:51 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-b9ed9ea7-06a9-4fb4-b015-99789bc65b75 req-1bdbbfd8-f7f7-40be-80e5-7cf128e9a192 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Terminate volume connection completed successfully. Jul 31 11:01:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-b9ed9ea7-06a9-4fb4-b015-99789bc65b75 req-1bdbbfd8-f7f7-40be-80e5-7cf128e9a192 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Deleting attachment 7a1bbd2d-4abb-4f2a-9b68-02f177af3606. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:01:56 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Acquiring lock "cinder-5e0aa496-3901-4516-afff-06e4a4dedb1d-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:56 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "cinder-5e0aa496-3901-4516-afff-06e4a4dedb1d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:56 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Acquiring lock "cinder-quobyte-5e0aa496-3901-4516-afff-06e4a4dedb1d" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:56 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "cinder-quobyte-5e0aa496-3901-4516-afff-06e4a4dedb1d" acquired by "delete_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:56 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[730e126c-27c1-47ef-8b41-8067b72dab96]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:56 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d Jul 31 11:01:56 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:57 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d" returned: 0 in 0.435s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:57 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d Jul 31 11:01:57 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:57 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5e0aa496-3901-4516-afff-06e4a4dedb1d" returned: 0 in 0.283s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "cinder-quobyte-5e0aa496-3901-4516-afff-06e4a4dedb1d" released by "delete_volume" :: held 0.785s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Created reservations ['d94948cf-64ef-4cf6-8d4a-869b58b7d764', '034b6333-cac8-476b-bdc5-06b97e01ba1c', '07453220-7f75-49a0-9eba-7a797efa506c', '48882254-0da1-4f64-9ad1-6e99ee45af4e'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:57 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:01:57 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Acquiring lock "cinder-a091c131-1a82-47b9-bd2d-2c651a8d6661-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "cinder-a091c131-1a82-47b9-bd2d-2c651a8d6661-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Acquiring lock "cinder-quobyte-a091c131-1a82-47b9-bd2d-2c651a8d6661" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "cinder-quobyte-a091c131-1a82-47b9-bd2d-2c651a8d6661" acquired by "delete_volume" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d0a513-cbb3-4287-9cc1-11ccc86d032a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:57 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.378s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:57 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:57 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Deleted volume successfully. Jul 31 11:01:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ddb7234c-6575-463b-abd7-a983d4364bc4 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "cinder-5e0aa496-3901-4516-afff-06e4a4dedb1d-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:58 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661 Jul 31 11:01:58 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:58 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661" returned: 0 in 0.462s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:58 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661 Jul 31 11:01:58 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:58 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a091c131-1a82-47b9-bd2d-2c651a8d6661" returned: 0 in 0.263s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "cinder-quobyte-a091c131-1a82-47b9-bd2d-2c651a8d6661" released by "delete_volume" :: held 0.776s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:58 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Created reservations ['5f432f81-85f7-4881-86e8-ecd35f207ae7', '2985fdb6-d2fb-4f95-a438-fb66c0dfb5cf', '57a15e53-5114-49ab-9c83-6cabeac2d8ff', '672a391b-15db-4e56-8277-f7bbad0f48e1'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:58 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:01:58 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:59 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.316s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:59 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:59 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Deleted volume successfully. Jul 31 11:01:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-271c9fde-8f69-42b2-8d41-0d36c3167ce0 tempest-TestServerVolumeAttachmentScenario-1418350161 None] Lock "cinder-a091c131-1a82-47b9-bd2d-2c651a8d6661-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:02 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-c3ffc0ec-23f3-4dee-a6b7-7a55e2e5885c req-241cb86e-a0e0-4df1-9a9a-84ece5c442a4 tempest-TestMinimumBasicScenario-941747030 None] Terminate volume connection completed successfully. Jul 31 11:02:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-c3ffc0ec-23f3-4dee-a6b7-7a55e2e5885c req-241cb86e-a0e0-4df1-9a9a-84ece5c442a4 tempest-TestMinimumBasicScenario-941747030 None] Deleting attachment c031be15-c90e-48aa-85e2-1c2b90be39ce. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:02:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Acquiring lock "cinder-2125b91b-ca6d-423f-8fb1-74460d4a9c19-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Lock "cinder-2125b91b-ca6d-423f-8fb1-74460d4a9c19-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Acquiring lock "cinder-quobyte-2125b91b-ca6d-423f-8fb1-74460d4a9c19" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Lock "cinder-quobyte-2125b91b-ca6d-423f-8fb1-74460d4a9c19" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:03 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[4183b8a1-ff4a-4f94-b990-63924888ad57]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:03 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19 Jul 31 11:02:03 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:03 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19" returned: 0 in 0.435s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:03 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19 Jul 31 11:02:03 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:04 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-2125b91b-ca6d-423f-8fb1-74460d4a9c19" returned: 0 in 0.320s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Lock "cinder-quobyte-2125b91b-ca6d-423f-8fb1-74460d4a9c19" released by "delete_volume" :: held 0.811s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:04 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Created reservations ['05d9d3f0-0f18-4215-be1c-a9cff3c6e752', 'cc2db9a3-89b7-476f-a235-3112fc9f6794', '66b750ac-cc7e-4858-b578-ecf4e30959bf', 'f17d1d30-a771-4fbb-b836-6394d343f2a4'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:04 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:04 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:04 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.392s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:04 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:04 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Deleted volume successfully. Jul 31 11:02:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4b107425-b29d-4b96-abf5-de26b0c86eab tempest-TestMinimumBasicScenario-941747030 None] Lock "cinder-2125b91b-ca6d-423f-8fb1-74460d4a9c19-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:02:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:08 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:08 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:08 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.412s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:02:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:02:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:02:14 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=45,cinder:UPDATE=41,cinder:INSERT=10,cinder:DELETE=5 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:02:14 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=45,cinder:UPDATE=49,cinder:INSERT=12,cinder:DELETE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:02:15 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Flow 'volume_create_manager' (41b213d5-938d-48fb-8e03-f156e587f783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6925ad28-41f9-474e-aa53-b58abff3678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6925ad28-41f9-474e-aa53-b58abff3678b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1221988973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5412fe4c-b16f-4035-9280-8bb7aea664f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2e3161d1de4f908a58bd9b6d9d4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:16Z,use_quota=True,user_id='81f1a0f638d942ffb91a8fdc199759b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6620c30-32fb-4adb-84fd-a649af8801ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6620c30-32fb-4adb-84fd-a649af8801ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0eeed95-f7b7-4b31-beeb-507f49a7e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0eeed95-f7b7-4b31-beeb-507f49a7e463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5412fe4c-b16f-4035-9280-8bb7aea664f1', 'volume_name': 'volume-5412fe4c-b16f-4035-9280-8bb7aea664f1', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5804e21a-e99f-4e72-8c5f-babf0bcbf8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5804e21a-e99f-4e72-8c5f-babf0bcbf8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6875f1c-ef28-4fe2-a488-7c85abefcb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:16 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume 5412fe4c-b16f-4035-9280-8bb7aea664f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5412fe4c-b16f-4035-9280-8bb7aea664f1', 'volume_size': 1} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1221988973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5412fe4c-b16f-4035-9280-8bb7aea664f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2e3161d1de4f908a58bd9b6d9d4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:16Z,use_quota=True,user_id='81f1a0f638d942ffb91a8fdc199759b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Creating volume 5412fe4c-b16f-4035-9280-8bb7aea664f1 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:16 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:16 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 1073741824 Jul 31 11:02:16 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:16 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 1073741824" returned: 0 in 0.718s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:16 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 Jul 31 11:02:16 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:17 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1" returned: 0 in 0.365s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6875f1c-ef28-4fe2-a488-7c85abefcb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5412fe4c-b16f-4035-9280-8bb7aea664f1', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d76627a-c06e-4faa-8a0f-0683986a152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:17 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 (5412fe4c-b16f-4035-9280-8bb7aea664f1): created successfully Jul 31 11:02:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d76627a-c06e-4faa-8a0f-0683986a152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Flow 'volume_create_manager' (41b213d5-938d-48fb-8e03-f156e587f783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:17 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-cbb3d651-b1ad-43c9-aec3-302a3382ecdb tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created volume successfully. Jul 31 11:02:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:18 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Creating offline snapshot 440b4bda-324e-4977-b879-0a9283090836 of volume 5412fe4c-b16f-4035-9280-8bb7aea664f1 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:02:18 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b099d2b7-7b07-4060-bb89-f8f6c3f9f0e4]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:18 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 Jul 31 11:02:18 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:18 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1" returned: 0 in 0.391s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:18 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 1G Jul 31 11:02:18 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:19 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 1G" returned: 0 in 0.743s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:19 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 Jul 31 11:02:19 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:19 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836" returned: 0 in 0.428s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:19 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 is being set with open permissions: ugo+rw Jul 31 11:02:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:19 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 Jul 31 11:02:19 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:20 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836" returned: 0 in 0.264s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:20 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.info Jul 31 11:02:20 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:20 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.info" returned: 0 in 0.306s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:20 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.info is being set with open permissions: ugo+rw Jul 31 11:02:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:20 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.info Jul 31 11:02:20 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:20 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.info" returned: 0 in 0.307s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.546s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:20 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d3028b93-9d12-43c4-8212-3d46e5aa7389 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Create snapshot completed successfully Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Flow 'volume_create_manager' (86ecb933-5d81-4727-9d0e-66f7849b51df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1cbb7f-68c2-4155-aa5e-2fab519ee28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1cbb7f-68c2-4155-aa5e-2fab519ee28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1414693386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3c0e26-6074-4911-a004-867ac54c4539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2e3161d1de4f908a58bd9b6d9d4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:22Z,use_quota=True,user_id='81f1a0f638d942ffb91a8fdc199759b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f72bd3-aacb-40a7-ae99-d4dcb3c5bef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f72bd3-aacb-40a7-ae99-d4dcb3c5bef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8738893-58db-41bd-959a-29f1f86d3058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8738893-58db-41bd-959a-29f1f86d3058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3c0e26-6074-4911-a004-867ac54c4539', 'volume_name': 'volume-3a3c0e26-6074-4911-a004-867ac54c4539', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b809929-52bd-4279-9966-dc5fffea58cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b809929-52bd-4279-9966-dc5fffea58cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69c65fe-ff93-4690-ace6-48c206cbd6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:22 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume 3a3c0e26-6074-4911-a004-867ac54c4539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3c0e26-6074-4911-a004-867ac54c4539', 'volume_size': 1} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1414693386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3c0e26-6074-4911-a004-867ac54c4539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2e3161d1de4f908a58bd9b6d9d4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:22Z,use_quota=True,user_id='81f1a0f638d942ffb91a8fdc199759b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Creating volume 3a3c0e26-6074-4911-a004-867ac54c4539 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:22 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a3c0e26-6074-4911-a004-867ac54c4539 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:22 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a3c0e26-6074-4911-a004-867ac54c4539 1073741824 Jul 31 11:02:22 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:22 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Flow 'volume_create_manager' (5cbc03a7-75ad-4025-9d4d-6fc06a242e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e264a8fd-a962-4e0e-bfe4-4ae49da1c3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e264a8fd-a962-4e0e-bfe4-4ae49da1c3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1171676156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f1cfc6-11aa-4afa-bc08-552a9179d5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2e3161d1de4f908a58bd9b6d9d4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:23Z,use_quota=True,user_id='81f1a0f638d942ffb91a8fdc199759b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52069ea5-cd99-4463-8003-af6d2a71998b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52069ea5-cd99-4463-8003-af6d2a71998b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c6845a-9fd3-481c-ba0f-a313e5561829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c6845a-9fd3-481c-ba0f-a313e5561829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f1cfc6-11aa-4afa-bc08-552a9179d5b8', 'volume_name': 'volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68efc1a2-bb5b-43e2-b87e-b9eb7ebcb42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68efc1a2-bb5b-43e2-b87e-b9eb7ebcb42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ccb645-d6d0-4bd4-b212-d7060262b954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:23 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume 36f1cfc6-11aa-4afa-bc08-552a9179d5b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8', 'volume_size': 1} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:23 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a3c0e26-6074-4911-a004-867ac54c4539 1073741824" returned: 0 in 0.797s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a3c0e26-6074-4911-a004-867ac54c4539 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:23 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a3c0e26-6074-4911-a004-867ac54c4539 Jul 31 11:02:23 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:23 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a3c0e26-6074-4911-a004-867ac54c4539" returned: 0 in 0.373s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1171676156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f1cfc6-11aa-4afa-bc08-552a9179d5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2e3161d1de4f908a58bd9b6d9d4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:23Z,use_quota=True,user_id='81f1a0f638d942ffb91a8fdc199759b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Creating volume 36f1cfc6-11aa-4afa-bc08-552a9179d5b8 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:23 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69c65fe-ff93-4690-ace6-48c206cbd6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3c0e26-6074-4911-a004-867ac54c4539', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:23 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8 1073741824 Jul 31 11:02:23 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb691ba-0ea3-4c5a-8fe1-a1d0b0bf906f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:23 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume volume-3a3c0e26-6074-4911-a004-867ac54c4539 (3a3c0e26-6074-4911-a004-867ac54c4539): created successfully Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb691ba-0ea3-4c5a-8fe1-a1d0b0bf906f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Flow 'volume_create_manager' (86ecb933-5d81-4727-9d0e-66f7849b51df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:23 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4a82a83b-9ac6-4054-aea4-b47ae5e82c8d tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created volume successfully. Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Flow 'volume_create_manager' (5e31f44d-5327-4e08-aa99-f1d6900b4430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2153d7a-f993-4014-a847-527c154ab6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2153d7a-f993-4014-a847-527c154ab6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1977908440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1f6f18-e37f-4b8d-96e4-bd1e9b693620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2e3161d1de4f908a58bd9b6d9d4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:24Z,use_quota=True,user_id='81f1a0f638d942ffb91a8fdc199759b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3532b4-e64d-4cc9-af66-2784dd776dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3532b4-e64d-4cc9-af66-2784dd776dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c213a824-e55b-49fb-ae77-ed1a5b7813a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c213a824-e55b-49fb-ae77-ed1a5b7813a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e1f6f18-e37f-4b8d-96e4-bd1e9b693620', 'volume_name': 'volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002f0a5b-6346-4b65-ae73-244e2e45232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002f0a5b-6346-4b65-ae73-244e2e45232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a658bb-69a0-49bf-9f94-6309a36536f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:24 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume 1e1f6f18-e37f-4b8d-96e4-bd1e9b693620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620', 'volume_size': 1} Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:24 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8 1073741824" returned: 0 in 0.844s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:24 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8 Jul 31 11:02:24 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:25 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Flow 'volume_create_manager' (0a536a80-0298-4260-b0e0-658ac6e4bb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4627be49-b6d6-4e52-8a1b-00cf17a434d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8" returned: 0 in 0.686s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.953s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1977908440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1f6f18-e37f-4b8d-96e4-bd1e9b693620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2e3161d1de4f908a58bd9b6d9d4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:24Z,use_quota=True,user_id='81f1a0f638d942ffb91a8fdc199759b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Creating volume 1e1f6f18-e37f-4b8d-96e4-bd1e9b693620 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:25 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4627be49-b6d6-4e52-8a1b-00cf17a434d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1053896954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44be5068-f4c6-4b72-8e1b-3282482ebf01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cb1fafd26c49f7b2cf0fab7cd81fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:25Z,use_quota=True,user_id='2504d1f48b3549c4b97368d731fb256c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6941314-10e6-445c-9e81-6720496d1785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6941314-10e6-445c-9e81-6720496d1785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620 1073741824 Jul 31 11:02:25 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2c80b7-9ad5-4d73-954f-820c75874554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2c80b7-9ad5-4d73-954f-820c75874554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44be5068-f4c6-4b72-8e1b-3282482ebf01', 'volume_name': 'volume-44be5068-f4c6-4b72-8e1b-3282482ebf01', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3123369d-4821-457f-8d59-5edbc26d8171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3123369d-4821-457f-8d59-5edbc26d8171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f78d8f9-9771-4287-8811-309b749e4d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Volume 44be5068-f4c6-4b72-8e1b-3282482ebf01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44be5068-f4c6-4b72-8e1b-3282482ebf01', 'volume_size': 1} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Flow 'volume_create_manager' (a5ca809a-194f-42ad-83ce-bd0441967ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35094416-704c-4bcf-8c4f-62f18550793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35094416-704c-4bcf-8c4f-62f18550793a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1835327017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e89b602-deb7-4d5b-8983-da15cb8db3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2e3161d1de4f908a58bd9b6d9d4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:25Z,use_quota=True,user_id='81f1a0f638d942ffb91a8fdc199759b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ca7e58-c591-43e5-a07e-04fae8cf51f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ca7e58-c591-43e5-a07e-04fae8cf51f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd7a78d-1528-45a2-b637-3ca4ea4a3dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd7a78d-1528-45a2-b637-3ca4ea4a3dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e89b602-deb7-4d5b-8983-da15cb8db3d4', 'volume_name': 'volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef8662f7-3dd0-4304-b0a7-ccc640cd8ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef8662f7-3dd0-4304-b0a7-ccc640cd8ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eff58dd-7bb2-4106-941d-a2f755c7016b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume 0e89b602-deb7-4d5b-8983-da15cb8db3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4', 'volume_size': 1} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ccb645-d6d0-4bd4-b212-d7060262b954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95aabebd-7b2e-47a3-9e04-0149475f1db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Flow 'volume_create_manager' (edef5a18-8db9-4e7f-8a13-22d4608d5129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84eb89fa-4039-4f48-a367-72cfaed4570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8 (36f1cfc6-11aa-4afa-bc08-552a9179d5b8): created successfully Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95aabebd-7b2e-47a3-9e04-0149475f1db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Flow 'volume_create_manager' (5cbc03a7-75ad-4025-9d4d-6fc06a242e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84eb89fa-4039-4f48-a367-72cfaed4570d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1454819501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b3a5dc-e4ae-4bd8-beae-78c621333026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2e3161d1de4f908a58bd9b6d9d4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:25Z,use_quota=True,user_id='81f1a0f638d942ffb91a8fdc199759b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0751dfb1-3205-4c21-8249-52c24b604c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0751dfb1-3205-4c21-8249-52c24b604c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39482c5e-d52e-4b57-a747-0c102bd71c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39482c5e-d52e-4b57-a747-0c102bd71c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5b3a5dc-e4ae-4bd8-beae-78c621333026', 'volume_name': 'volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c8bd30-5768-4485-a09e-49f2daad45f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c8bd30-5768-4485-a09e-49f2daad45f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fed76e-5468-4905-9fa9-0a7bec9454f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:25 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume e5b3a5dc-e4ae-4bd8-beae-78c621333026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026', 'volume_size': 1} Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:25 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c5de84bb-555c-47b7-bae9-dcc68576ca86 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created volume successfully. Jul 31 11:02:25 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620 1073741824" returned: 0 in 0.605s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:26 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620 Jul 31 11:02:26 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:26 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620" returned: 0 in 0.266s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.854s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1053896954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44be5068-f4c6-4b72-8e1b-3282482ebf01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cb1fafd26c49f7b2cf0fab7cd81fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:25Z,use_quota=True,user_id='2504d1f48b3549c4b97368d731fb256c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Creating volume 44be5068-f4c6-4b72-8e1b-3282482ebf01 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:26 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-44be5068-f4c6-4b72-8e1b-3282482ebf01 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a658bb-69a0-49bf-9f94-6309a36536f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:26 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-44be5068-f4c6-4b72-8e1b-3282482ebf01 1073741824 Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140e1449-213b-425f-bcc7-f48fd72966c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:26 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:26 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620 (1e1f6f18-e37f-4b8d-96e4-bd1e9b693620): created successfully Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140e1449-213b-425f-bcc7-f48fd72966c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Flow 'volume_create_manager' (5e31f44d-5327-4e08-aa99-f1d6900b4430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:26 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9fe89b87-f8d5-4a62-8bba-acdfb8e1c29f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created volume successfully. Jul 31 11:02:26 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-44be5068-f4c6-4b72-8e1b-3282482ebf01 1073741824" returned: 0 in 0.481s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-44be5068-f4c6-4b72-8e1b-3282482ebf01 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:26 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-44be5068-f4c6-4b72-8e1b-3282482ebf01 Jul 31 11:02:26 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:27 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-44be5068-f4c6-4b72-8e1b-3282482ebf01" returned: 0 in 0.315s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.607s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1835327017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e89b602-deb7-4d5b-8983-da15cb8db3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2e3161d1de4f908a58bd9b6d9d4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:25Z,use_quota=True,user_id='81f1a0f638d942ffb91a8fdc199759b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Creating volume 0e89b602-deb7-4d5b-8983-da15cb8db3d4 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:27 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f78d8f9-9771-4287-8811-309b749e4d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44be5068-f4c6-4b72-8e1b-3282482ebf01', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d23940-29ce-4c66-889e-3ec989f65685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:27 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4 1073741824 Jul 31 11:02:27 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:27 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Volume volume-44be5068-f4c6-4b72-8e1b-3282482ebf01 (44be5068-f4c6-4b72-8e1b-3282482ebf01): created successfully Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d23940-29ce-4c66-889e-3ec989f65685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Flow 'volume_create_manager' (0a536a80-0298-4260-b0e0-658ac6e4bb23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:27 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-fec27b85-1c89-4e35-a1b6-3a0c24c877c4 tempest-VolumesActionsTest-819623763 None] Created volume successfully. Jul 31 11:02:27 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4 1073741824" returned: 0 in 0.501s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:27 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4 Jul 31 11:02:27 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:27 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4" returned: 0 in 0.278s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.281s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1454819501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b3a5dc-e4ae-4bd8-beae-78c621333026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2e3161d1de4f908a58bd9b6d9d4b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:25Z,use_quota=True,user_id='81f1a0f638d942ffb91a8fdc199759b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Creating volume e5b3a5dc-e4ae-4bd8-beae-78c621333026 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:28 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eff58dd-7bb2-4106-941d-a2f755c7016b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53d3482-febc-4483-ad00-d1d3145712e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:28 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026 1073741824 Jul 31 11:02:28 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:28 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4 (0e89b602-deb7-4d5b-8983-da15cb8db3d4): created successfully Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53d3482-febc-4483-ad00-d1d3145712e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Flow 'volume_create_manager' (a5ca809a-194f-42ad-83ce-bd0441967ccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:28 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-97c39de3-1bce-47fe-b7ec-7abfe82b22c8 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created volume successfully. Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ee21bbec-0ca2-4d50-a3ce-3aba02cb405e tempest-VolumesActionsTest-819623763 None] Acquiring lock "cinder-44be5068-f4c6-4b72-8e1b-3282482ebf01" by "attach_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ee21bbec-0ca2-4d50-a3ce-3aba02cb405e tempest-VolumesActionsTest-819623763 None] Lock "cinder-44be5068-f4c6-4b72-8e1b-3282482ebf01" acquired by "attach_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:28 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ee21bbec-0ca2-4d50-a3ce-3aba02cb405e tempest-VolumesActionsTest-819623763 None] Attaching volume 44be5068-f4c6-4b72-8e1b-3282482ebf01 to instance 07deded0-7048-4e98-86f5-8e4a7e9a466f at mountpoint /dev/vdb on host None. Jul 31 11:02:28 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ee21bbec-0ca2-4d50-a3ce-3aba02cb405e tempest-VolumesActionsTest-819623763 None] Attach volume completed successfully. Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ee21bbec-0ca2-4d50-a3ce-3aba02cb405e tempest-VolumesActionsTest-819623763 None] Lock "cinder-44be5068-f4c6-4b72-8e1b-3282482ebf01" released by "attach_volume" :: held 0.130s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:28 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026 1073741824" returned: 0 in 0.581s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:28 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026 Jul 31 11:02:28 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:28 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026" returned: 0 in 0.350s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fed76e-5468-4905-9fa9-0a7bec9454f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fcd621-add6-428f-a142-e5a31bb9d6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:29 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Volume volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026 (e5b3a5dc-e4ae-4bd8-beae-78c621333026): created successfully Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fcd621-add6-428f-a142-e5a31bb9d6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Flow 'volume_create_manager' (edef5a18-8db9-4e7f-8a13-22d4608d5129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e2caea1e-176d-4f81-8e99-dc4d092abeee tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created volume successfully. Jul 31 11:02:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-484436d3-9556-463f-ab6e-8031c8eddd91 tempest-VolumesActionsTest-1787527610 None] Terminate volume connection completed successfully. Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-484436d3-9556-463f-ab6e-8031c8eddd91 tempest-VolumesActionsTest-1787527610 None] Acquiring lock "cinder-44be5068-f4c6-4b72-8e1b-3282482ebf01-detach_volume" by "detach_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-484436d3-9556-463f-ab6e-8031c8eddd91 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-44be5068-f4c6-4b72-8e1b-3282482ebf01-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-e5b3a5dc-e4ae-4bd8-beae-78c621333026-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-484436d3-9556-463f-ab6e-8031c8eddd91 tempest-VolumesActionsTest-1787527610 None] Detaching volume 44be5068-f4c6-4b72-8e1b-3282482ebf01 from instance 07deded0-7048-4e98-86f5-8e4a7e9a466f. Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-e5b3a5dc-e4ae-4bd8-beae-78c621333026-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-quobyte-e5b3a5dc-e4ae-4bd8-beae-78c621333026" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-e5b3a5dc-e4ae-4bd8-beae-78c621333026" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-484436d3-9556-463f-ab6e-8031c8eddd91 tempest-VolumesActionsTest-1787527610 None] Detach volume completed successfully. Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-484436d3-9556-463f-ab6e-8031c8eddd91 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-44be5068-f4c6-4b72-8e1b-3282482ebf01-detach_volume" released by "detach_volume" :: held 0.199s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d135d2f-b706-49e7-9073-eef166d46ba6]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:29 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026 Jul 31 11:02:29 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6ef51609-59c8-4f22-8f87-b99ed5283a2c tempest-VolumesActionsTest-819623763 None] Acquiring lock "cinder-44be5068-f4c6-4b72-8e1b-3282482ebf01-detach_volume" by "detach_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6ef51609-59c8-4f22-8f87-b99ed5283a2c tempest-VolumesActionsTest-819623763 None] Lock "cinder-44be5068-f4c6-4b72-8e1b-3282482ebf01-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6ef51609-59c8-4f22-8f87-b99ed5283a2c tempest-VolumesActionsTest-819623763 None] Volume detach called, but volume not attached. Jul 31 11:02:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6ef51609-59c8-4f22-8f87-b99ed5283a2c tempest-VolumesActionsTest-819623763 None] Lock "cinder-44be5068-f4c6-4b72-8e1b-3282482ebf01-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:30 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026" returned: 0 in 0.504s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:30 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026 Jul 31 11:02:30 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Acquiring lock "cinder-44be5068-f4c6-4b72-8e1b-3282482ebf01-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Lock "cinder-44be5068-f4c6-4b72-8e1b-3282482ebf01-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Acquiring lock "cinder-quobyte-44be5068-f4c6-4b72-8e1b-3282482ebf01" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Lock "cinder-quobyte-44be5068-f4c6-4b72-8e1b-3282482ebf01" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8a5d7a-444c-4e52-8fe3-0022395be157]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-44be5068-f4c6-4b72-8e1b-3282482ebf01 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:30 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e5b3a5dc-e4ae-4bd8-beae-78c621333026" returned: 0 in 0.423s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-e5b3a5dc-e4ae-4bd8-beae-78c621333026" released by "delete_volume" :: held 0.978s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:30 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-44be5068-f4c6-4b72-8e1b-3282482ebf01 Jul 31 11:02:30 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created reservations ['23350776-acf8-432c-ac21-afdda33effa1', '14a015c3-1949-4264-90a3-a5eff2e84ac2', '15e6430b-6237-43e6-bf6d-b76b8a20d510', '05d7ec8f-5415-4a27-b6f5-4fe4505d01fa'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:30 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:30 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:30 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-44be5068-f4c6-4b72-8e1b-3282482ebf01" returned: 0 in 0.525s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-44be5068-f4c6-4b72-8e1b-3282482ebf01 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:30 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-44be5068-f4c6-4b72-8e1b-3282482ebf01 Jul 31 11:02:30 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:31 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.398s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:31 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Deleted volume successfully. Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f86abcf2-e1a3-440b-b4ee-28c0d54c8c42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-e5b3a5dc-e4ae-4bd8-beae-78c621333026-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:31 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-44be5068-f4c6-4b72-8e1b-3282482ebf01" returned: 0 in 0.391s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Lock "cinder-quobyte-44be5068-f4c6-4b72-8e1b-3282482ebf01" released by "delete_volume" :: held 0.965s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Created reservations ['ed3bc06c-4995-4830-8a21-919093cb0c5b', '13d43e46-e09e-4432-a62f-01958949127c', 'e7bf72c0-cb30-44db-b267-e464fa032ebc', '3ccb3b36-59b4-42e2-9199-2a35cae37311'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:31 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:31 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-0e89b602-deb7-4d5b-8983-da15cb8db3d4-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:31 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-0e89b602-deb7-4d5b-8983-da15cb8db3d4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.298s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:31 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Deleted volume successfully. Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5011f5ac-507e-4c44-9770-4128a5b12850 tempest-VolumesActionsTest-819623763 None] Lock "cinder-44be5068-f4c6-4b72-8e1b-3282482ebf01-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-quobyte-0e89b602-deb7-4d5b-8983-da15cb8db3d4" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-0e89b602-deb7-4d5b-8983-da15cb8db3d4" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[544c291f-102f-4dcc-816f-9776551e8ba9]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:31 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4 Jul 31 11:02:31 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:32 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4" returned: 0 in 0.411s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:32 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4 Jul 31 11:02:32 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:32 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0e89b602-deb7-4d5b-8983-da15cb8db3d4" returned: 0 in 0.333s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-0e89b602-deb7-4d5b-8983-da15cb8db3d4" released by "delete_volume" :: held 0.796s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:32 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created reservations ['df21973b-c869-41a8-b5c6-b2cbb4759c19', 'ffcba25a-8a1b-4cd0-bf0c-40198f46abe8', '32336d4a-43fc-478b-adeb-b10d347f8e77', 'afdd9fdb-043f-49c8-a254-981b42ef97b4'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:32 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:32 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-quobyte-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620" acquired by "delete_volume" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:33 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a874ce1-d328-45e3-9649-7e5bec166243]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:33 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.460s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:33 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:33 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Deleted volume successfully. Jul 31 11:02:33 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620 Jul 31 11:02:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-667a56d6-dd52-4e0e-bad8-760fbd5cdaca tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-0e89b602-deb7-4d5b-8983-da15cb8db3d4-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:33 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:33 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620" returned: 0 in 0.501s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:33 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620 Jul 31 11:02:33 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:33 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620" returned: 0 in 0.333s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620" released by "delete_volume" :: held 0.894s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:34 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created reservations ['98c4057c-5109-4e94-a29e-42cfafc774f7', 'b65fdb60-1d00-4387-8235-fb7e265e1079', '647e4e20-34cd-4749-939d-322e8d0c37c3', '262488f4-7cb8-4df0-bdb1-343e9ac8b9e8'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:34 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:34 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:34 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.342s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:34 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:34 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Deleted volume successfully. Jul 31 11:02:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-69fb3350-1deb-4703-94fb-0a06ffc1ca42 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-1e1f6f18-e37f-4b8d-96e4-bd1e9b693620-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-36f1cfc6-11aa-4afa-bc08-552a9179d5b8-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-36f1cfc6-11aa-4afa-bc08-552a9179d5b8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-quobyte-36f1cfc6-11aa-4afa-bc08-552a9179d5b8" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-36f1cfc6-11aa-4afa-bc08-552a9179d5b8" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:35 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceaedd0-7907-4f98-8e6a-e2599829e16d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:35 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8 Jul 31 11:02:35 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:35 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8" returned: 0 in 0.541s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:36 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8 Jul 31 11:02:36 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Flow 'volume_create_manager' (6718973f-e767-46ed-8343-48384a7bcb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b80b7d-d502-49d4-89f0-d72c3c950047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b80b7d-d502-49d4-89f0-d72c3c950047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-922547142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc3dac0f-7112-47e0-bf5b-7d486b30276c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cb1fafd26c49f7b2cf0fab7cd81fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:36Z,use_quota=True,user_id='2504d1f48b3549c4b97368d731fb256c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e232535-1b6e-404e-b0e2-160766ebca8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e232535-1b6e-404e-b0e2-160766ebca8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093da49c-f601-46e4-bd2a-7f9b8d7343f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093da49c-f601-46e4-bd2a-7f9b8d7343f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc3dac0f-7112-47e0-bf5b-7d486b30276c', 'volume_name': 'volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaab0786-6f96-4f58-aaed-ab6b39a27a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaab0786-6f96-4f58-aaed-ab6b39a27a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42f40c1-9de4-4d01-b37e-1bdc52f8226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:36 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Volume cc3dac0f-7112-47e0-bf5b-7d486b30276c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c', 'volume_size': 1} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-922547142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc3dac0f-7112-47e0-bf5b-7d486b30276c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cb1fafd26c49f7b2cf0fab7cd81fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:36Z,use_quota=True,user_id='2504d1f48b3549c4b97368d731fb256c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Creating volume cc3dac0f-7112-47e0-bf5b-7d486b30276c {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:36 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:36 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c 1073741824 Jul 31 11:02:36 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:36 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-36f1cfc6-11aa-4afa-bc08-552a9179d5b8" returned: 0 in 0.440s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-36f1cfc6-11aa-4afa-bc08-552a9179d5b8" released by "delete_volume" :: held 1.049s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created reservations ['8ea7e92d-8ed5-486b-9c3b-31bc7d64491c', '4ac6390d-5ad7-4a35-bf76-4c5825deb386', '2f7f01cc-ccb1-4efb-be06-ebc992d2217c', 'd6b56074-4480-4279-8db1-55a145466c19'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:36 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:36 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:36 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.269s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:36 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c 1073741824" returned: 0 in 0.550s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:36 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Deleted volume successfully. Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-76e80454-eac4-4851-84c2-3e750b0c31ab tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-36f1cfc6-11aa-4afa-bc08-552a9179d5b8-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:36 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c Jul 31 11:02:36 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:37 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c" returned: 0 in 0.266s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42f40c1-9de4-4d01-b37e-1bdc52f8226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e5c38e-28c0-480d-b6fb-cbde4e3ee04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:37 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Volume volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c (cc3dac0f-7112-47e0-bf5b-7d486b30276c): created successfully Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e5c38e-28c0-480d-b6fb-cbde4e3ee04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Flow 'volume_create_manager' (6718973f-e767-46ed-8343-48384a7bcb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:37 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-fed82038-f6b4-4ee9-bd06-5358483dfd33 tempest-VolumesActionsTest-819623763 None] Created volume successfully. Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-3a3c0e26-6074-4911-a004-867ac54c4539-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-3a3c0e26-6074-4911-a004-867ac54c4539-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-quobyte-3a3c0e26-6074-4911-a004-867ac54c4539" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-3a3c0e26-6074-4911-a004-867ac54c4539" acquired by "delete_volume" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbbac6d-8497-4f42-8b5c-d9d51cd1fa30]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a3c0e26-6074-4911-a004-867ac54c4539 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:37 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a3c0e26-6074-4911-a004-867ac54c4539 Jul 31 11:02:37 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:38 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a3c0e26-6074-4911-a004-867ac54c4539" returned: 0 in 0.370s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a3c0e26-6074-4911-a004-867ac54c4539 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:38 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a3c0e26-6074-4911-a004-867ac54c4539 Jul 31 11:02:38 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:38 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a3c0e26-6074-4911-a004-867ac54c4539" returned: 0 in 0.262s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-3a3c0e26-6074-4911-a004-867ac54c4539" released by "delete_volume" :: held 0.682s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created reservations ['663349cb-491c-4bd3-b662-dee59545e411', '81eaac8a-7ab5-4109-bc30-85c6292a47e0', '96c55d72-24c0-40d4-842b-88f0e11719af', 'a8187c9d-a6ea-4595-8f72-960551500445'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:38 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:38 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Acquiring lock "cinder-cc3dac0f-7112-47e0-bf5b-7d486b30276c-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-cc3dac0f-7112-47e0-bf5b-7d486b30276c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Acquiring lock "cinder-quobyte-cc3dac0f-7112-47e0-bf5b-7d486b30276c" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-quobyte-cc3dac0f-7112-47e0-bf5b-7d486b30276c" acquired by "delete_volume" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8baa16-c07a-4732-aa27-ae7f80f86432]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-440b4bda-324e-4977-b879-0a9283090836-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-440b4bda-324e-4977-b879-0a9283090836-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-quobyte-5412fe4c-b16f-4035-9280-8bb7aea664f1" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-5412fe4c-b16f-4035-9280-8bb7aea664f1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-quobyte-440b4bda-324e-4977-b879-0a9283090836" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-440b4bda-324e-4977-b879-0a9283090836" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Deleting offline snapshot 440b4bda-324e-4977-b879-0a9283090836 of volume 5412fe4c-b16f-4035-9280-8bb7aea664f1 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:02:38 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c Jul 31 11:02:38 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] snapshot_file for this snap is: volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8751aad8-6977-41fc-b95b-677d8fb67184]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:38 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.389s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Deleted volume successfully. Jul 31 11:02:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-254fc065-7b6a-4975-b85d-3a4be97e0b06 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-3a3c0e26-6074-4911-a004-867ac54c4539-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:39 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 Jul 31 11:02:39 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:39 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c" returned: 0 in 0.497s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:39 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c Jul 31 11:02:39 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:39 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836" returned: 0 in 0.431s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5412fe4c-b16f-4035-9280-8bb7aea664f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdd561e-31e0-4561-aba1-617fecd25f55]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:39 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc3dac0f-7112-47e0-bf5b-7d486b30276c" returned: 0 in 0.282s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-quobyte-cc3dac0f-7112-47e0-bf5b-7d486b30276c" released by "delete_volume" :: held 0.834s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:39 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 Jul 31 11:02:39 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Created reservations ['97608365-f495-4a86-9707-c02005785dd7', '37b5c60a-b06a-46a8-975c-57276e681c34', '349433d7-ed8d-4700-b4ed-6824daade198', '46317654-a188-44de-82dd-7dd5383e35d5'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:39 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:39 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:39 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1" returned: 0 in 0.493s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:39 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 Jul 31 11:02:39 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:39 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.322s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:39 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Deleted volume successfully. Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5718c2a-9d45-43a9-91cc-687d2b3c67c1 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-cc3dac0f-7112-47e0-bf5b-7d486b30276c-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:40 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836" returned: 0 in 0.472s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:40 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836 Jul 31 11:02:40 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Flow 'volume_create_manager' (d0ba0cbb-fbd7-4e99-a896-e19d8fff8ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b2e11e-e594-46b2-a7f7-8a9b030b1adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b2e11e-e594-46b2-a7f7-8a9b030b1adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-415534167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c2c718-ebeb-40bf-a18b-4c51c3d87fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cb1fafd26c49f7b2cf0fab7cd81fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:40Z,use_quota=True,user_id='2504d1f48b3549c4b97368d731fb256c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ba33b1-a100-425f-aaeb-75ecb4774f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ba33b1-a100-425f-aaeb-75ecb4774f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ed380e-7bc1-4b51-ad57-167554743f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ed380e-7bc1-4b51-ad57-167554743f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c2c718-ebeb-40bf-a18b-4c51c3d87fa0', 'volume_name': 'volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a75ce8b-139f-4416-9581-d3e2921a799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a75ce8b-139f-4416-9581-d3e2921a799d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662b7897-c0aa-40e0-b54d-de72938aae6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:40 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Volume 65c2c718-ebeb-40bf-a18b-4c51c3d87fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0', 'volume_size': 1} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-415534167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c2c718-ebeb-40bf-a18b-4c51c3d87fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cb1fafd26c49f7b2cf0fab7cd81fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:40Z,use_quota=True,user_id='2504d1f48b3549c4b97368d731fb256c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Creating volume 65c2c718-ebeb-40bf-a18b-4c51c3d87fa0 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:40 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:40 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0 1073741824 Jul 31 11:02:40 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:40 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1.440b4bda-324e-4977-b879-0a9283090836" returned: 0 in 0.261s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-440b4bda-324e-4977-b879-0a9283090836" released by "_delete_snapshot" :: held 1.810s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-5412fe4c-b16f-4035-9280-8bb7aea664f1" released by "delete_snapshot" :: held 1.837s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created reservations ['eca2caac-edfd-4d2a-bc66-7cb362c452af', '04c03535-08a3-43e5-885c-067dfe261da2', 'bd8581b9-715a-49d2-a0fa-cc8362f32ac3', 'a5676ad9-e332-4dbc-a97b-5e369ab45a55'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:40 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Delete snapshot completed successfully. Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-edd4d434-a964-47f7-b97b-5da6ed6c64f4 tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-440b4bda-324e-4977-b879-0a9283090836-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-5412fe4c-b16f-4035-9280-8bb7aea664f1-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-5412fe4c-b16f-4035-9280-8bb7aea664f1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "cinder-quobyte-5412fe4c-b16f-4035-9280-8bb7aea664f1" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-5412fe4c-b16f-4035-9280-8bb7aea664f1" acquired by "delete_volume" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:41 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0 1073741824" returned: 0 in 0.582s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c668062f-5666-41a5-bf4a-1c3d5e767bcc]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:41 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0 Jul 31 11:02:41 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:41 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 Jul 31 11:02:41 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:41 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0" returned: 0 in 0.298s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662b7897-c0aa-40e0-b54d-de72938aae6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7f7ed1-16c1-4dde-9e69-fc16fb9155fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:41 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Volume volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0 (65c2c718-ebeb-40bf-a18b-4c51c3d87fa0): created successfully Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7f7ed1-16c1-4dde-9e69-fc16fb9155fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:41 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Flow 'volume_create_manager' (d0ba0cbb-fbd7-4e99-a896-e19d8fff8ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1" returned: 0 in 0.396s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:41 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-0c723dc0-5f4e-44a5-a8c4-3cef75fc0f8a tempest-VolumesActionsTest-819623763 None] Created volume successfully. Jul 31 11:02:41 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1 Jul 31 11:02:41 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:41 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-5412fe4c-b16f-4035-9280-8bb7aea664f1" returned: 0 in 0.245s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-quobyte-5412fe4c-b16f-4035-9280-8bb7aea664f1" released by "delete_volume" :: held 0.726s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Created reservations ['621f3b6b-25d3-4ac2-b6bb-059d7ead5abd', '002dd48c-bf80-41f1-9e7d-9127901c3b2c', '1c241d0c-9d99-4345-b4a1-db3e76ac6eab', 'b6bb6d41-8927-4b7e-9a82-973888d8cfb2'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:41 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:41 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:42 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.331s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:42 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Deleted volume successfully. Jul 31 11:02:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1f924a55-23c2-49ee-98c7-e15bd4569b4f tempest-CreateVolumesFromSnapshotTest-1278092647 None] Lock "cinder-5412fe4c-b16f-4035-9280-8bb7aea664f1-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Acquiring lock "cinder-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Acquiring lock "cinder-quobyte-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-quobyte-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0" acquired by "delete_volume" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:42 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3d14e1-46c9-4f89-b14f-547d4e8986c9]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:42 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0 Jul 31 11:02:42 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:43 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0" returned: 0 in 0.457s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:43 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0 Jul 31 11:02:43 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:43 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0" returned: 0 in 0.284s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-quobyte-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0" released by "delete_volume" :: held 0.784s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Created reservations ['143000d0-b01f-4729-9e9f-9d2d54ec5034', 'd551f294-cd88-4120-8b3e-efcaa7cdca66', 'f5fe3e26-106d-4867-a2d7-c54b4aea66f2', '8e6c27e8-ab2c-4d08-a220-ba1a3fa4dc52'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:43 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:43 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:43 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.293s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:43 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:43 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Deleted volume successfully. Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71aa8c26-b5d7-4521-bf86-9091c90e3a23 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-65c2c718-ebeb-40bf-a18b-4c51c3d87fa0-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Flow 'volume_create_manager' (d2632558-1bf2-40fe-892d-38ee315d49f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba54755c-c984-4ff3-b8f0-331d62e7e96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba54755c-c984-4ff3-b8f0-331d62e7e96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-680204113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19a69d1-f1a4-4685-804d-7cb8ff43c828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cb1fafd26c49f7b2cf0fab7cd81fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:44Z,use_quota=True,user_id='2504d1f48b3549c4b97368d731fb256c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d8edb4-a5ca-4b92-a5f0-51860ed20908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d8edb4-a5ca-4b92-a5f0-51860ed20908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e1186c-c019-4686-aaf8-55c92d0fd144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e1186c-c019-4686-aaf8-55c92d0fd144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f19a69d1-f1a4-4685-804d-7cb8ff43c828', 'volume_name': 'volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2f34ff-57e7-4dde-8d0b-e5edcfc39700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2f34ff-57e7-4dde-8d0b-e5edcfc39700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e04bec-cc2c-4e83-82cd-15d037bede8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:44 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Volume f19a69d1-f1a4-4685-804d-7cb8ff43c828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828', 'volume_size': 1} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-680204113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19a69d1-f1a4-4685-804d-7cb8ff43c828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cb1fafd26c49f7b2cf0fab7cd81fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:44Z,use_quota=True,user_id='2504d1f48b3549c4b97368d731fb256c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Creating volume f19a69d1-f1a4-4685-804d-7cb8ff43c828 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:44 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:44 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828 1073741824 Jul 31 11:02:44 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:45 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828 1073741824" returned: 0 in 0.509s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:45 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828 Jul 31 11:02:45 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:45 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828" returned: 0 in 0.324s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e04bec-cc2c-4e83-82cd-15d037bede8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b9ebe7-a8dc-4316-8122-b197c8b55ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:45 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Volume volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828 (f19a69d1-f1a4-4685-804d-7cb8ff43c828): created successfully Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b9ebe7-a8dc-4316-8122-b197c8b55ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Flow 'volume_create_manager' (d2632558-1bf2-40fe-892d-38ee315d49f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-078c8b8e-91cc-4476-ac01-2923e830f756 tempest-VolumesActionsTest-819623763 None] Created volume successfully. Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Flow 'volume_create_manager' (187ba2d4-cecb-4ea6-98a6-4eb628bcf510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3452ecb5-b5fd-4ee5-9193-2bcbc15fd0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3452ecb5-b5fd-4ee5-9193-2bcbc15fd0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1910690488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0487e4f2-2cc3-4e63-b697-2ba986bdc36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0bbe4d0e4724abd8462ffb09130622d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:46Z,use_quota=True,user_id='b4d03b55681e4414a541dff2a019c913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c988d6-c61d-4b12-a622-adbfa0c571af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c988d6-c61d-4b12-a622-adbfa0c571af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42f16ef-348b-4c79-afc0-88d52567e922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42f16ef-348b-4c79-afc0-88d52567e922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0487e4f2-2cc3-4e63-b697-2ba986bdc36f', 'volume_name': 'volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198e828a-d16b-4e76-be1a-e9b2f7e7d3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198e828a-d16b-4e76-be1a-e9b2f7e7d3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fea9d3-950a-41e4-a220-2db09490e930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:45 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Volume 0487e4f2-2cc3-4e63-b697-2ba986bdc36f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f', 'volume_size': 1} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1910690488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0487e4f2-2cc3-4e63-b697-2ba986bdc36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0bbe4d0e4724abd8462ffb09130622d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:46Z,use_quota=True,user_id='b4d03b55681e4414a541dff2a019c913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Creating volume 0487e4f2-2cc3-4e63-b697-2ba986bdc36f {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:45 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:45 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f 1073741824 Jul 31 11:02:45 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:46 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f 1073741824" returned: 0 in 0.502s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:46 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f Jul 31 11:02:46 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:46 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" returned: 0 in 0.297s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fea9d3-950a-41e4-a220-2db09490e930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2763efff-6b64-4bcf-aaa6-87d7f5177945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:46 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Volume volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f (0487e4f2-2cc3-4e63-b697-2ba986bdc36f): created successfully Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2763efff-6b64-4bcf-aaa6-87d7f5177945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Flow 'volume_create_manager' (187ba2d4-cecb-4ea6-98a6-4eb628bcf510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:46 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2a858f5e-9755-4c93-a87d-fdd7726d59b9 tempest-VolumeDependencyTests-309661945 None] Created volume successfully. Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Acquiring lock "cinder-f19a69d1-f1a4-4685-804d-7cb8ff43c828-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-f19a69d1-f1a4-4685-804d-7cb8ff43c828-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Acquiring lock "cinder-quobyte-f19a69d1-f1a4-4685-804d-7cb8ff43c828" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-quobyte-f19a69d1-f1a4-4685-804d-7cb8ff43c828" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[527ee6fc-273b-475e-80f2-10e94a25e23c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:47 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828 Jul 31 11:02:47 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:47 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828" returned: 0 in 0.430s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:47 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828 Jul 31 11:02:47 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:47 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f19a69d1-f1a4-4685-804d-7cb8ff43c828" returned: 0 in 0.255s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-quobyte-f19a69d1-f1a4-4685-804d-7cb8ff43c828" released by "delete_volume" :: held 0.733s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:47 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Created reservations ['c95942a9-c411-4972-b48d-a10cf60075d8', 'e452e998-9429-4e66-a1bb-0c2847562b27', '4a3897f9-f478-4f48-9dc3-1e7cf4820bec', 'ccf182df-7e95-4477-933f-c32e15615e53'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:47 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:47 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] Creating offline snapshot e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 of volume 0487e4f2-2cc3-4e63-b697-2ba986bdc36f {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45525ae-38ce-4a57-a8ec-51f7fc6d4576]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:48 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.393s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:48 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Deleted volume successfully. Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4615c3ca-31a4-4d41-9296-9de8abec2c97 tempest-VolumesActionsTest-1787527610 None] Lock "cinder-f19a69d1-f1a4-4685-804d-7cb8ff43c828-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:48 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f Jul 31 11:02:48 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:48 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" returned: 0 in 0.474s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:48 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 1G Jul 31 11:02:48 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Flow 'volume_create_manager' (e318ff0a-7bf0-4697-9902-e438c731de5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4383136b-cb8e-44bf-91b7-3a53055aed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4383136b-cb8e-44bf-91b7-3a53055aed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-611316110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243ac416-257a-4b60-a71c-d9a7c147375f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cb1fafd26c49f7b2cf0fab7cd81fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:49Z,use_quota=True,user_id='2504d1f48b3549c4b97368d731fb256c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545ce30a-0896-40f6-8221-8721b2ea648a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545ce30a-0896-40f6-8221-8721b2ea648a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51c87df-1ee9-4fce-95a6-6bc36fed7504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51c87df-1ee9-4fce-95a6-6bc36fed7504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243ac416-257a-4b60-a71c-d9a7c147375f', 'volume_name': 'volume-243ac416-257a-4b60-a71c-d9a7c147375f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd06963-5e19-4e78-9162-3ae4afee4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd06963-5e19-4e78-9162-3ae4afee4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a23de0-dd69-461f-a0cd-367b9543b795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:48 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Volume 243ac416-257a-4b60-a71c-d9a7c147375f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243ac416-257a-4b60-a71c-d9a7c147375f', 'volume_size': 1} Jul 31 11:02:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:49 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 1G" returned: 0 in 0.602s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:49 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 Jul 31 11:02:49 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:49 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8" returned: 0 in 0.335s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:49 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 is being set with open permissions: ugo+rw Jul 31 11:02:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:49 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 Jul 31 11:02:49 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:49 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8" returned: 0 in 0.266s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:49 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.info Jul 31 11:02:49 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:50 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.info" returned: 0 in 0.283s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:50 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.info is being set with open permissions: ugo+rw Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:50 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.info Jul 31 11:02:50 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:50 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.info" returned: 0 in 0.239s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.479s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-611316110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243ac416-257a-4b60-a71c-d9a7c147375f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cb1fafd26c49f7b2cf0fab7cd81fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:49Z,use_quota=True,user_id='2504d1f48b3549c4b97368d731fb256c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Creating volume 243ac416-257a-4b60-a71c-d9a7c147375f {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:50 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-243ac416-257a-4b60-a71c-d9a7c147375f 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:50 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-243ac416-257a-4b60-a71c-d9a7c147375f 1073741824 Jul 31 11:02:50 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:50 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8ce45caa-bd41-4969-8d47-b813528815c9 tempest-VolumeDependencyTests-309661945 None] Create snapshot completed successfully Jul 31 11:02:50 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-243ac416-257a-4b60-a71c-d9a7c147375f 1073741824" returned: 0 in 0.521s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-243ac416-257a-4b60-a71c-d9a7c147375f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:50 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-243ac416-257a-4b60-a71c-d9a7c147375f Jul 31 11:02:50 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:51 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-243ac416-257a-4b60-a71c-d9a7c147375f" returned: 0 in 0.273s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a23de0-dd69-461f-a0cd-367b9543b795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243ac416-257a-4b60-a71c-d9a7c147375f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43a15ce-fae2-4bcf-bafb-127c38200bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:51 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Volume volume-243ac416-257a-4b60-a71c-d9a7c147375f (243ac416-257a-4b60-a71c-d9a7c147375f): created successfully Jul 31 11:02:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43a15ce-fae2-4bcf-bafb-127c38200bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Flow 'volume_create_manager' (e318ff0a-7bf0-4697-9902-e438c731de5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:51 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-0e926fc5-a5f2-48f9-8221-30e4929d7b68 tempest-VolumesActionsTest-819623763 None] Created volume successfully. Jul 31 11:02:51 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Flow 'volume_create_manager' (5579c0b6-a9fd-491e-81e3-ebc064fcdb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f872a6-6898-4e54-b553-cc7b8a60067b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Acquiring lock "cinder-243ac416-257a-4b60-a71c-d9a7c147375f-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f872a6-6898-4e54-b553-cc7b8a60067b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1417934794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab365d2c-e1e8-4733-853f-bf42672b34bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0bbe4d0e4724abd8462ffb09130622d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e9f26a51-0f49-4d7c-baa9-9febc6bf86f8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:52Z,use_quota=True,user_id='b4d03b55681e4414a541dff2a019c913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9140c5f1-726a-4992-9b52-a055f702ce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9140c5f1-726a-4992-9b52-a055f702ce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b9a6ed-e32c-421b-97e9-437025d38109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b9a6ed-e32c-421b-97e9-437025d38109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ab365d2c-e1e8-4733-853f-bf42672b34bf', 'volume_name': 'volume-ab365d2c-e1e8-4733-853f-bf42672b34bf', 'volume_size': 1, 'snapshot_id': 'e9f26a51-0f49-4d7c-baa9-9febc6bf86f8'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b812ecf3-c4b3-4658-a76e-dfb342f544c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b812ecf3-c4b3-4658-a76e-dfb342f544c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96fa24c7-e4a0-44a6-9937-c1e8d726b639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Volume ab365d2c-e1e8-4733-853f-bf42672b34bf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ab365d2c-e1e8-4733-853f-bf42672b34bf', 'volume_size': 1, 'snapshot_id': 'e9f26a51-0f49-4d7c-baa9-9febc6bf86f8'} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Lock "cinder-243ac416-257a-4b60-a71c-d9a7c147375f-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Acquiring lock "cinder-quobyte-e9f26a51-0f49-4d7c-baa9-9febc6bf86f8-ab365d2c-e1e8-4733-853f-bf42672b34bf" by "_create_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Lock "cinder-quobyte-e9f26a51-0f49-4d7c-baa9-9febc6bf86f8-ab365d2c-e1e8-4733-853f-bf42672b34bf" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Creating volume ab365d2c-e1e8-4733-853f-bf42672b34bf from snapshot e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 {{(pid=89145) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Acquiring lock "cinder-quobyte-ab365d2c-e1e8-4733-853f-bf42672b34bf" by "_copy_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Lock "cinder-quobyte-ab365d2c-e1e8-4733-853f-bf42672b34bf" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] snapshot: e9f26a51-0f49-4d7c-baa9-9febc6bf86f8, volume: ab365d2c-e1e8-4733-853f-bf42672b34bf, {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Acquiring lock "cinder-quobyte-243ac416-257a-4b60-a71c-d9a7c147375f" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Lock "cinder-quobyte-243ac416-257a-4b60-a71c-d9a7c147375f" acquired by "delete_volume" :: waited 0.050s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc1c2ca-0a99-4429-8bd8-6b76f1b46620]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b954fdc-6208-432d-81d2-fb702810dd11]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-243ac416-257a-4b60-a71c-d9a7c147375f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:52 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-243ac416-257a-4b60-a71c-d9a7c147375f Jul 31 11:02:52 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:52 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 Jul 31 11:02:52 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:52 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8" returned: 0 in 0.426s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Creating direct copy from snapshot {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c2a1cf-c872-4eeb-bb91-12a266cec8f6]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:52 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-243ac416-257a-4b60-a71c-d9a7c147375f" returned: 0 in 0.456s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-243ac416-257a-4b60-a71c-d9a7c147375f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:52 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-243ac416-257a-4b60-a71c-d9a7c147375f Jul 31 11:02:52 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:52 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f Jul 31 11:02:52 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:53 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-243ac416-257a-4b60-a71c-d9a7c147375f" returned: 0 in 0.352s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:53 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" returned: 0 in 0.394s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG cinder.utils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Path /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf not found in is_blk_device check {{(pid=89145) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Lock "cinder-quobyte-243ac416-257a-4b60-a71c-d9a7c147375f" released by "delete_volume" :: held 0.868s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:53 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf Jul 31 11:02:53 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Created reservations ['ef525de1-f45e-4a80-a09b-bd24e4db8d2d', '7459d30a-bf2c-46c4-b495-8da6492d25fc', '78737b12-3d77-4bd6-aeaa-63732a3664c6', '6821a1c9-3d70-4391-aa06-d5ef7229c3cc'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:53 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:02:53 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:53 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.289s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:53 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Deleted volume successfully. Jul 31 11:02:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8055cac2-c851-464c-a9a1-a899147dce4f tempest-VolumesActionsTest-1787527610 None] Lock "cinder-243ac416-257a-4b60-a71c-d9a7c147375f-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:56 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Flow 'volume_create_manager' (05e3cba2-b679-4c17-a2eb-a7a789a38a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4833918a-f865-4b04-bfd1-f864d8e9e7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4833918a-f865-4b04-bfd1-f864d8e9e7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-625405605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd436391-52f6-43c2-b81e-a295846eabe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cb1fafd26c49f7b2cf0fab7cd81fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:56Z,use_quota=True,user_id='2504d1f48b3549c4b97368d731fb256c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c299bdd9-7c31-4e36-b560-7e3d64de7d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c299bdd9-7c31-4e36-b560-7e3d64de7d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687ba2f7-086b-4aa9-b0a8-eab473427df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687ba2f7-086b-4aa9-b0a8-eab473427df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd436391-52f6-43c2-b81e-a295846eabe8', 'volume_name': 'volume-cd436391-52f6-43c2-b81e-a295846eabe8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbe5b5b-11a2-4223-abd5-52476fab3a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbe5b5b-11a2-4223-abd5-52476fab3a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f346caf1-e99f-46c7-933d-d3473f80c67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:56 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Volume cd436391-52f6-43c2-b81e-a295846eabe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd436391-52f6-43c2-b81e-a295846eabe8', 'volume_size': 1} Jul 31 11:02:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:58 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf" returned: 0 in 5.551s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:58 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3217c7-8435-4b55-9311-81b134b375f7]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:58 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f Jul 31 11:02:58 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:59 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" returned: 0 in 0.602s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:02:59 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Converted 1024.00 MB image at 184.45 MB/s Jul 31 11:02:59 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf is being set with open permissions: ugo+rw Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:59 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf Jul 31 11:02:59 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:59 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf" returned: 0 in 0.288s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Lock "cinder-quobyte-ab365d2c-e1e8-4733-853f-bf42672b34bf" released by "_copy_volume_from_snapshot" :: held 7.384s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Lock "cinder-quobyte-e9f26a51-0f49-4d7c-baa9-9febc6bf86f8-ab365d2c-e1e8-4733-853f-bf42672b34bf" released by "_create_volume_from_snapshot" :: held 7.426s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.452s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.229s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-625405605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd436391-52f6-43c2-b81e-a295846eabe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cb1fafd26c49f7b2cf0fab7cd81fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:56Z,use_quota=True,user_id='2504d1f48b3549c4b97368d731fb256c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Creating volume cd436391-52f6-43c2-b81e-a295846eabe8 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:59 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cd436391-52f6-43c2-b81e-a295846eabe8 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:59 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cd436391-52f6-43c2-b81e-a295846eabe8 1073741824 Jul 31 11:02:59 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96fa24c7-e4a0-44a6-9937-c1e8d726b639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab365d2c-e1e8-4733-853f-bf42672b34bf', 'volume_size': 1, 'snapshot_id': 'e9f26a51-0f49-4d7c-baa9-9febc6bf86f8'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219e195b-ea58-49fb-9349-0e9a333b6a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:59 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Volume volume-ab365d2c-e1e8-4733-853f-bf42672b34bf (ab365d2c-e1e8-4733-853f-bf42672b34bf): created successfully Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219e195b-ea58-49fb-9349-0e9a333b6a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Flow 'volume_create_manager' (5579c0b6-a9fd-491e-81e3-ebc064fcdb77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:59 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8badee5b-b276-4ec3-be31-555ebb4c88aa tempest-VolumeDependencyTests-309661945 None] Created volume successfully. Jul 31 11:03:00 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cd436391-52f6-43c2-b81e-a295846eabe8 1073741824" returned: 0 in 0.528s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cd436391-52f6-43c2-b81e-a295846eabe8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:00 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cd436391-52f6-43c2-b81e-a295846eabe8 Jul 31 11:03:00 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:00 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cd436391-52f6-43c2-b81e-a295846eabe8" returned: 0 in 0.315s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f346caf1-e99f-46c7-933d-d3473f80c67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd436391-52f6-43c2-b81e-a295846eabe8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df93898-a1c6-46a4-981f-fc93f3f23528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:00 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Volume volume-cd436391-52f6-43c2-b81e-a295846eabe8 (cd436391-52f6-43c2-b81e-a295846eabe8): created successfully Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df93898-a1c6-46a4-981f-fc93f3f23528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Flow 'volume_create_manager' (05e3cba2-b679-4c17-a2eb-a7a789a38a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:00 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4e0edc93-4b94-46e7-ab06-27122d2b8cbb tempest-VolumesActionsTest-819623763 None] Created volume successfully. Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Acquiring lock "cinder-e9f26a51-0f49-4d7c-baa9-9febc6bf86f8-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Lock "cinder-e9f26a51-0f49-4d7c-baa9-9febc6bf86f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Acquiring lock "cinder-quobyte-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Lock "cinder-quobyte-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Acquiring lock "cinder-quobyte-e9f26a51-0f49-4d7c-baa9-9febc6bf86f8" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Lock "cinder-quobyte-e9f26a51-0f49-4d7c-baa9-9febc6bf86f8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Deleting offline snapshot e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 of volume 0487e4f2-2cc3-4e63-b697-2ba986bdc36f {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] snapshot_file for this snap is: volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[df11d577-fdca-4e47-bd2e-53919a55069c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:01 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 Jul 31 11:03:01 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:01 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8" returned: 0 in 0.378s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:01 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ee7d03-1d9d-44d3-835f-151028c6f54e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:01 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f Jul 31 11:03:01 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:01 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" returned: 0 in 0.459s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:01 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 Jul 31 11:03:01 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Acquiring lock "cinder-cd436391-52f6-43c2-b81e-a295846eabe8-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:02 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8" returned: 0 in 0.428s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Lock "cinder-cd436391-52f6-43c2-b81e-a295846eabe8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:02 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8 Jul 31 11:03:02 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Acquiring lock "cinder-quobyte-cd436391-52f6-43c2-b81e-a295846eabe8" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Lock "cinder-quobyte-cd436391-52f6-43c2-b81e-a295846eabe8" acquired by "delete_volume" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3122fdc-a62e-4c98-b7c5-fccf1ad6ace0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cd436391-52f6-43c2-b81e-a295846eabe8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:02 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cd436391-52f6-43c2-b81e-a295846eabe8 Jul 31 11:03:02 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:02 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f.e9f26a51-0f49-4d7c-baa9-9febc6bf86f8" returned: 0 in 0.293s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Lock "cinder-quobyte-e9f26a51-0f49-4d7c-baa9-9febc6bf86f8" released by "_delete_snapshot" :: held 1.687s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Lock "cinder-quobyte-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" released by "delete_snapshot" :: held 1.717s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Created reservations ['aead2eb3-fc49-42e2-872c-305acc949589', 'b3ad8a7c-a226-4ff2-97e2-77f748411baa', '384e97de-f7d6-4c91-b735-2a7227e5e321', '0fafe8b2-e4ca-490e-9d16-699442fcb3f7'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:02 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Delete snapshot completed successfully. Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-71141057-8771-4ca2-bd39-12f96729df93 tempest-VolumeDependencyTests-309661945 None] Lock "cinder-e9f26a51-0f49-4d7c-baa9-9febc6bf86f8-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:02 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cd436391-52f6-43c2-b81e-a295846eabe8" returned: 0 in 0.439s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cd436391-52f6-43c2-b81e-a295846eabe8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:02 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cd436391-52f6-43c2-b81e-a295846eabe8 Jul 31 11:03:02 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Flow 'volume_create_manager' (c7cd86a7-ead3-4d19-81fd-abdc98e81043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44a381d-449f-4a21-adde-ac94ee0cfba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44a381d-449f-4a21-adde-ac94ee0cfba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-732077231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec27cda6-40bd-4862-a6a8-d3af171b0113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aecac2cf56445059eb2caa3766b8ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:03Z,use_quota=True,user_id='7fe2f87ca2464220a61ff1acfdede7b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a734e1a-5124-4fb7-a169-06bfd666732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a734e1a-5124-4fb7-a169-06bfd666732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6717d838-a16d-43fc-be0d-73f0dd3bfecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:02 devstack cinder-volume[89145]: DEBUG cinder.image.glance [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Creating Keystone auth plugin from conf {{(pid=89145) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Acquiring lock "cinder-0487e4f2-2cc3-4e63-b697-2ba986bdc36f-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Lock "cinder-0487e4f2-2cc3-4e63-b697-2ba986bdc36f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Acquiring lock "cinder-quobyte-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:03 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Lock "cinder-quobyte-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cd436391-52f6-43c2-b81e-a295846eabe8" returned: 0 in 0.325s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Lock "cinder-quobyte-cd436391-52f6-43c2-b81e-a295846eabe8" released by "delete_volume" :: held 0.808s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b915f64a-d30f-4c11-b249-cd13c63d78b8]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Created reservations ['92376b78-49f7-4db3-8f51-5b7560e8da40', '34ddd6c8-3b77-44c2-9348-31e4e401cf0d', '1faa12c3-b71d-4c35-b761-1826c497f9a4', 'fb767280-6a71-48b3-a620-df6fb749be8e'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:03 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f Jul 31 11:03:03 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:03 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:03 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6717d838-a16d-43fc-be0d-73f0dd3bfecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec27cda6-40bd-4862-a6a8-d3af171b0113', 'volume_name': 'volume-ec27cda6-40bd-4862-a6a8-d3af171b0113', 'volume_size': 1, 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47167fa6716a45acb0b64b020ce63fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23773fd9-78aa-4e92-89da-78a5b0acf9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23773fd9-78aa-4e92-89da-78a5b0acf9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787c88f9-b9e2-4dc2-83be-d1c9ccad3867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:03 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Volume ec27cda6-40bd-4862-a6a8-d3af171b0113: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec27cda6-40bd-4862-a6a8-d3af171b0113', 'volume_size': 1, 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47167fa6716a45acb0b64b020ce63fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Trying to clone ec27cda6-40bd-4862-a6a8-d3af171b0113 from image 73b2b0b0-b476-43bf-9b0b-2363c12be17d at location (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]). {{(pid=89145) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:03:03 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.275s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:03 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Deleted volume successfully. Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-92ddd3ba-8feb-4dda-85fd-6141bc4d0400 tempest-VolumesActionsTest-819623763 None] Lock "cinder-cd436391-52f6-43c2-b81e-a295846eabe8-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:03 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" returned: 0 in 0.493s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:03 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f Jul 31 11:03:03 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:03:03 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Image download 20.69 MB at 20.69 MB/s Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd4c29d-0b4f-4284-82bc-734e99e27e44]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:03 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" returned: 0 in 0.351s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Lock "cinder-quobyte-0487e4f2-2cc3-4e63-b697-2ba986bdc36f" released by "delete_volume" :: held 0.919s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:04 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD Jul 31 11:03:04 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Created reservations ['8014ddaa-35ef-451e-b937-a0e2e81c6d5a', 'dd393e56-78d3-4883-94c9-3f0ddc792b4d', 'a3b8b443-3587-4714-905c-4156a429a4d2', 'f249f9cf-e5db-4be1-a4c5-b00eb9bfab1d'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:04 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:04 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:04 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Temporary image 73b2b0b0-b476-43bf-9b0b-2363c12be17d is fetched for user 7fe2f87ca2464220a61ff1acfdede7b8. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[64097ab9-d77a-4e81-99b6-444df2845a0f]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:04 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.264s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:04 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Deleted volume successfully. Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c2ff0cd9-bd65-4b75-85b0-d735cbbcce84 tempest-VolumeDependencyTests-309661945 None] Lock "cinder-0487e4f2-2cc3-4e63-b697-2ba986bdc36f-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:04 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD Jul 31 11:03:04 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:04 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-732077231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec27cda6-40bd-4862-a6a8-d3af171b0113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aecac2cf56445059eb2caa3766b8ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:03Z,use_quota=True,user_id='7fe2f87ca2464220a61ff1acfdede7b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Creating volume ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:04 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:03:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:04 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 1073741824 Jul 31 11:03:04 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Acquiring lock "cinder-ab365d2c-e1e8-4733-853f-bf42672b34bf-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Lock "cinder-ab365d2c-e1e8-4733-853f-bf42672b34bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:05 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 1073741824" returned: 0 in 0.523s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Acquiring lock "cinder-quobyte-ab365d2c-e1e8-4733-853f-bf42672b34bf" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Lock "cinder-quobyte-ab365d2c-e1e8-4733-853f-bf42672b34bf" acquired by "delete_volume" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37e934a-7e7b-4d49-894a-812dee21164f]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:05 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 Jul 31 11:03:05 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:05 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf Jul 31 11:03:05 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:05 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113" returned: 0 in 0.302s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Attempting download of 73b2b0b0-b476-43bf-9b0b-2363c12be17d ((None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}])) to volume ec27cda6-40bd-4862-a6a8-d3af171b0113. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3355fd3-2b85-42df-963f-23f7fbd524ff]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_wuqk3pho {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:05 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf" returned: 0 in 0.411s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:05 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf Jul 31 11:03:05 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:05 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_wuqk3pho Jul 31 11:03:05 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:06 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ab365d2c-e1e8-4733-853f-bf42672b34bf" returned: 0 in 0.303s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Lock "cinder-quobyte-ab365d2c-e1e8-4733-853f-bf42672b34bf" released by "delete_volume" :: held 0.776s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Created reservations ['4a5974f9-8dc6-4229-8e67-859597f666ae', 'ca92a49c-053d-469e-9670-59d3174edd90', 'ab9c53c5-3022-4f5b-89ca-0df402f77dfb', 'faee9f00-9043-490c-a539-3b347daa752a'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:06 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_wuqk3pho" returned: 0 in 0.460s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_wuqk3pho {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:06 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:06 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:06 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_wuqk3pho Jul 31 11:03:06 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:06 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.302s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:06 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Deleted volume successfully. Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-08536fbb-c67f-4c49-b4e2-8202e230237c tempest-VolumeDependencyTests-309661945 None] Lock "cinder-ab365d2c-e1e8-4733-853f-bf42672b34bf-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:06 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_wuqk3pho" returned: 1 in 0.445s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73b2b0b0-b476-43bf-9b0b-2363c12be17d_wuqk3pho' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6025ba2-0b27-45be-80c4-a3af0b1b8cff]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:06 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD Jul 31 11:03:06 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:07 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:07 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] 73b2b0b0-b476-43bf-9b0b-2363c12be17d was qcow2, converting to raw {{(pid=89145) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:03:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:07 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 Jul 31 11:03:07 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:08 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:08 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:08 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.354s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:03:08 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113" returned: 0 in 1.915s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_73b2b0b0-b476-43bf-9b0b-2363c12be17d_vsn9ho0mdevstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:03:08 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Converted 112.00 MB image at 58.43 MB/s Jul 31 11:03:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:09 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 1G Jul 31 11:03:09 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:09 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 1G" returned: 0 in 0.378s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:09 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e362e50-4ff2-44a9-92e2-8b4b4aad95eb]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:09 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 Jul 31 11:03:09 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:09 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113" returned: 0 in 0.379s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:09 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 Jul 31 11:03:09 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:10 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113" returned: 1 in 0.401s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:10 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Downloaded image 73b2b0b0-b476-43bf-9b0b-2363c12be17d ((None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}])) to volume ec27cda6-40bd-4862-a6a8-d3af171b0113 successfully. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:03:10 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Temporary image 73b2b0b0-b476-43bf-9b0b-2363c12be17d for user 7fe2f87ca2464220a61ff1acfdede7b8 is deleted. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:03:10 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Marking volume ec27cda6-40bd-4862-a6a8-d3af171b0113 as bootable. {{(pid=89145) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:03:10 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Copying metadata from image 73b2b0b0-b476-43bf-9b0b-2363c12be17d to ec27cda6-40bd-4862-a6a8-d3af171b0113. {{(pid=89145) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:03:10 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Creating volume glance metadata for volume ec27cda6-40bd-4862-a6a8-d3af171b0113 backed by image 73b2b0b0-b476-43bf-9b0b-2363c12be17d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89145) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:03:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787c88f9-b9e2-4dc2-83be-d1c9ccad3867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec27cda6-40bd-4862-a6a8-d3af171b0113', 'volume_size': 1, 'image_id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '47167fa6716a45acb0b64b020ce63fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '73b2b0b0-b476-43bf-9b0b-2363c12be17d', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73b2b0b0-b476-43bf-9b0b-2363c12be17d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4daaf0ac-f5a9-4e2b-a87e-bf5b42c06415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:10 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Volume volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 (ec27cda6-40bd-4862-a6a8-d3af171b0113): created successfully Jul 31 11:03:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4daaf0ac-f5a9-4e2b-a87e-bf5b42c06415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Flow 'volume_create_manager' (c7cd86a7-ead3-4d19-81fd-abdc98e81043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-05ad03b2-1607-4139-ae90-0535ade01afa tempest-TestShelveInstance-444766395 None] Created volume successfully. Jul 31 11:03:12 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Flow 'volume_create_manager' (fd2401ad-242b-452d-a3f6-614eb38cd6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebc9f4b-49f1-441b-befb-90e7e5a00a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebc9f4b-49f1-441b-befb-90e7e5a00a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc67289-1021-405e-b558-b0f721e01d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9509992b77542bba1adaa64fd511e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:13Z,use_quota=True,user_id='e42237c963e348238286673a6b5cf006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0095cfdc-6277-4f67-b361-03081454665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0095cfdc-6277-4f67-b361-03081454665d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b636df56-e086-4b93-a4a3-3e9f957e6818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:12 devstack cinder-volume[89145]: DEBUG cinder.image.glance [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Creating Keystone auth plugin from conf {{(pid=89145) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:03:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b636df56-e086-4b93-a4a3-3e9f957e6818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ddc67289-1021-405e-b558-b0f721e01d34', 'volume_name': 'volume-ddc67289-1021-405e-b558-b0f721e01d34', 'volume_size': 1, 'image_id': 'cab21a3b-4472-4f35-9953-4508ac1c638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cab21a3b-4472-4f35-9953-4508ac1c638b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38e666e0f62b7cef48b797244ff21aa2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e9509992b77542bba1adaa64fd511e05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd8a5ac5bc759508d8157846fe0da86f692b6a0202bc21fa835314f4618de6f966ec51f9fe357aa76cf4557203e685e0448afd2d83ce3a03cb73d3b63a74240d4', 'id': 'cab21a3b-4472-4f35-9953-4508ac1c638b', 'created_at': datetime.datetime(2026, 7, 31, 9, 3, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 3, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cab21a3b-4472-4f35-9953-4508ac1c638b/file', 'properties': {}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736ada51-1c2a-410b-9002-75fa42d0a85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736ada51-1c2a-410b-9002-75fa42d0a85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd23ef8-d299-4885-9c67-c6b8398b29de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:13 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Volume ddc67289-1021-405e-b558-b0f721e01d34: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ddc67289-1021-405e-b558-b0f721e01d34', 'volume_size': 1, 'image_id': 'cab21a3b-4472-4f35-9953-4508ac1c638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cab21a3b-4472-4f35-9953-4508ac1c638b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38e666e0f62b7cef48b797244ff21aa2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e9509992b77542bba1adaa64fd511e05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd8a5ac5bc759508d8157846fe0da86f692b6a0202bc21fa835314f4618de6f966ec51f9fe357aa76cf4557203e685e0448afd2d83ce3a03cb73d3b63a74240d4', 'id': 'cab21a3b-4472-4f35-9953-4508ac1c638b', 'created_at': datetime.datetime(2026, 7, 31, 9, 3, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 3, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cab21a3b-4472-4f35-9953-4508ac1c638b/file', 'properties': {}}, 'image_service': } Jul 31 11:03:13 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Trying to clone ddc67289-1021-405e-b558-b0f721e01d34 from image cab21a3b-4472-4f35-9953-4508ac1c638b at location (None, [{'url': 'file:///opt/stack/data/glance/images/cab21a3b-4472-4f35-9953-4508ac1c638b', 'metadata': {}}]). {{(pid=89145) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:03:13 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:03:13 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Image download 0.00 MB at 0.00 MB/s Jul 31 11:03:13 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b184b-9a47-4366-8ea1-c600cb74dd69]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:13 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD Jul 31 11:03:13 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:13 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:14 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD Jul 31 11:03:14 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:14 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:14 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Temporary image cab21a3b-4472-4f35-9953-4508ac1c638b is fetched for user e42237c963e348238286673a6b5cf006. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:03:14 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=133,cinder:UPDATE=170,cinder:INSERT=50,cinder:DELETE=17 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:03:14 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abd5010-fdbd-4275-bd7c-e990ba1ff97b]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:14 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD Jul 31 11:03:14 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-918b7c41-fb35-48a7-bdfb-3fe69dc3f968 req-116b1e18-8944-4e1f-a8cd-474af5625865 tempest-TestShelveInstance-444766395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-918b7c41-fb35-48a7-bdfb-3fe69dc3f968 req-116b1e18-8944-4e1f-a8cd-474af5625865 tempest-TestShelveInstance-444766395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:14 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[55be2a90-c3ac-41e9-90bb-1607330d6ff1]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-918b7c41-fb35-48a7-bdfb-3fe69dc3f968 req-116b1e18-8944-4e1f-a8cd-474af5625865 tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:14 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:15 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 Jul 31 11:03:15 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:15 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD Jul 31 11:03:15 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:15 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD" returned: 1 in 0.428s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:15 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-918b7c41-fb35-48a7-bdfb-3fe69dc3f968 req-116b1e18-8944-4e1f-a8cd-474af5625865 tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113" returned: 0 in 0.612s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-918b7c41-fb35-48a7-bdfb-3fe69dc3f968 req-116b1e18-8944-4e1f-a8cd-474af5625865 tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:15 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 Jul 31 11:03:15 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:16 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-918b7c41-fb35-48a7-bdfb-3fe69dc3f968 req-116b1e18-8944-4e1f-a8cd-474af5625865 tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113" returned: 1 in 0.508s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-918b7c41-fb35-48a7-bdfb-3fe69dc3f968 req-116b1e18-8944-4e1f-a8cd-474af5625865 tempest-TestShelveInstance-444766395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-918b7c41-fb35-48a7-bdfb-3fe69dc3f968 req-116b1e18-8944-4e1f-a8cd-474af5625865 tempest-TestShelveInstance-444766395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.196s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc67289-1021-405e-b558-b0f721e01d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9509992b77542bba1adaa64fd511e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:13Z,use_quota=True,user_id='e42237c963e348238286673a6b5cf006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Creating volume ddc67289-1021-405e-b558-b0f721e01d34 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:16 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=141,cinder:UPDATE=182,cinder:INSERT=46,cinder:DELETE=14 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:03:16 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 1073741824 Jul 31 11:03:16 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-918b7c41-fb35-48a7-bdfb-3fe69dc3f968 req-116b1e18-8944-4e1f-a8cd-474af5625865 tempest-TestShelveInstance-444766395 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-ec27cda6-40bd-4862-a6a8-d3af171b0113', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ceaa5302-461b-4072-b7a9-dce35b938c30', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:03:16 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-918b7c41-fb35-48a7-bdfb-3fe69dc3f968 req-116b1e18-8944-4e1f-a8cd-474af5625865 tempest-TestShelveInstance-444766395 None] attachment_update completed successfully. Jul 31 11:03:16 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 1073741824" returned: 0 in 0.716s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:16 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 Jul 31 11:03:16 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:17 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34" returned: 0 in 0.329s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:17 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Attempting download of cab21a3b-4472-4f35-9953-4508ac1c638b ((None, [{'url': 'file:///opt/stack/data/glance/images/cab21a3b-4472-4f35-9953-4508ac1c638b', 'metadata': {}}])) to volume ddc67289-1021-405e-b558-b0f721e01d34. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:03:17 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c395427-659d-4e78-a5fb-6aef5d121a23]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cab21a3b-4472-4f35-9953-4508ac1c638b_9nj7bkyg {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:17 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cab21a3b-4472-4f35-9953-4508ac1c638b_9nj7bkyg Jul 31 11:03:17 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:17 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cab21a3b-4472-4f35-9953-4508ac1c638b_9nj7bkyg" returned: 0 in 0.430s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cab21a3b-4472-4f35-9953-4508ac1c638b_9nj7bkyg {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:17 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cab21a3b-4472-4f35-9953-4508ac1c638b_9nj7bkyg Jul 31 11:03:17 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:18 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cab21a3b-4472-4f35-9953-4508ac1c638b_9nj7bkyg" returned: 1 in 0.495s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cab21a3b-4472-4f35-9953-4508ac1c638b_9nj7bkyg' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:18 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe522e5-5fe7-428f-977a-d63e053317d1]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:18 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD Jul 31 11:03:18 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:18 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:19 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD Jul 31 11:03:19 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:19 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD" returned: 1 in 0.578s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] cab21a3b-4472-4f35-9953-4508ac1c638b was raw, converting to raw {{(pid=89145) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:19 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 Jul 31 11:03:19 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Flow 'volume_create_manager' (510cbda0-3d1f-4997-8cf8-1ff2bb141deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957166cd-ca83-4952-9bca-58f0e49406cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957166cd-ca83-4952-9bca-58f0e49406cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1398700328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde827b0-eca5-4e18-80db-66147c7787bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198445eb4eed47a88361bd4312df9c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:20Z,use_quota=True,user_id='5cd96d9b6b2a4d57bb9d3bbe7c8f2b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbafd08d-0659-4efa-b4ad-cf1559e296a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbafd08d-0659-4efa-b4ad-cf1559e296a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d072837-f35d-41ab-80a2-c7d106d87800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d072837-f35d-41ab-80a2-c7d106d87800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde827b0-eca5-4e18-80db-66147c7787bc', 'volume_name': 'volume-cde827b0-eca5-4e18-80db-66147c7787bc', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d33dc3-737b-44bb-9dbc-e289ebd18edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d33dc3-737b-44bb-9dbc-e289ebd18edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100a2bb7-0048-4068-ab1f-e47bf30cc3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:19 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Volume cde827b0-eca5-4e18-80db-66147c7787bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde827b0-eca5-4e18-80db-66147c7787bc', 'volume_size': 1} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1398700328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde827b0-eca5-4e18-80db-66147c7787bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198445eb4eed47a88361bd4312df9c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:20Z,use_quota=True,user_id='5cd96d9b6b2a4d57bb9d3bbe7c8f2b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Creating volume cde827b0-eca5-4e18-80db-66147c7787bc {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:19 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:19 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc 1073741824 Jul 31 11:03:19 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:19 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34" returned: 0 in 0.458s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cab21a3b-4472-4f35-9953-4508ac1c638b_nw_r_ipedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:03:19 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 11:03:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:19 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 1G Jul 31 11:03:19 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:20 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 1G" returned: 0 in 0.408s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea17bc3d-0975-4897-b077-202d8459a6e1]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:20 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc 1073741824" returned: 0 in 0.565s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:20 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc Jul 31 11:03:20 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:20 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 Jul 31 11:03:20 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:20 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc" returned: 0 in 0.261s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100a2bb7-0048-4068-ab1f-e47bf30cc3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde827b0-eca5-4e18-80db-66147c7787bc', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd7f593-98d6-4c5f-adc4-ad668f9cbb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:20 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Volume volume-cde827b0-eca5-4e18-80db-66147c7787bc (cde827b0-eca5-4e18-80db-66147c7787bc): created successfully Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd7f593-98d6-4c5f-adc4-ad668f9cbb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Flow 'volume_create_manager' (510cbda0-3d1f-4997-8cf8-1ff2bb141deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:20 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f0bc1e5c-5bd5-490e-9ecc-a46951f93e9d tempest-VolumesDeleteCascade-606679403 None] Created volume successfully. Jul 31 11:03:20 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34" returned: 0 in 0.478s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:20 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 Jul 31 11:03:20 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:21 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34" returned: 1 in 0.445s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Downloaded image cab21a3b-4472-4f35-9953-4508ac1c638b ((None, [{'url': 'file:///opt/stack/data/glance/images/cab21a3b-4472-4f35-9953-4508ac1c638b', 'metadata': {}}])) to volume ddc67289-1021-405e-b558-b0f721e01d34 successfully. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Temporary image cab21a3b-4472-4f35-9953-4508ac1c638b for user e42237c963e348238286673a6b5cf006 is deleted. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Marking volume ddc67289-1021-405e-b558-b0f721e01d34 as bootable. {{(pid=89145) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Copying metadata from image cab21a3b-4472-4f35-9953-4508ac1c638b to ddc67289-1021-405e-b558-b0f721e01d34. {{(pid=89145) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Creating volume glance metadata for volume ddc67289-1021-405e-b558-b0f721e01d34 backed by image cab21a3b-4472-4f35-9953-4508ac1c638b with: {'image_id': 'cab21a3b-4472-4f35-9953-4508ac1c638b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '38e666e0f62b7cef48b797244ff21aa2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89145) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd23ef8-d299-4885-9c67-c6b8398b29de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc67289-1021-405e-b558-b0f721e01d34', 'volume_size': 1, 'image_id': 'cab21a3b-4472-4f35-9953-4508ac1c638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cab21a3b-4472-4f35-9953-4508ac1c638b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38e666e0f62b7cef48b797244ff21aa2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e9509992b77542bba1adaa64fd511e05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd8a5ac5bc759508d8157846fe0da86f692b6a0202bc21fa835314f4618de6f966ec51f9fe357aa76cf4557203e685e0448afd2d83ce3a03cb73d3b63a74240d4', 'id': 'cab21a3b-4472-4f35-9953-4508ac1c638b', 'created_at': datetime.datetime(2026, 7, 31, 9, 3, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 3, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cab21a3b-4472-4f35-9953-4508ac1c638b/file', 'properties': {}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef534979-a6bd-4dee-87a3-d19d4f551f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:21 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Volume volume-ddc67289-1021-405e-b558-b0f721e01d34 (ddc67289-1021-405e-b558-b0f721e01d34): created successfully Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef534979-a6bd-4dee-87a3-d19d4f551f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Flow 'volume_create_manager' (fd2401ad-242b-452d-a3f6-614eb38cd6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:21 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a4b7c216-3de6-46f1-a690-fbc505212c22 tempest-VolumeImageDependencyTests-540052007 None] Created volume successfully. Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Acquiring lock "cinder-ddc67289-1021-405e-b558-b0f721e01d34-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Lock "cinder-ddc67289-1021-405e-b558-b0f721e01d34-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Acquiring lock "cinder-quobyte-ddc67289-1021-405e-b558-b0f721e01d34" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Lock "cinder-quobyte-ddc67289-1021-405e-b558-b0f721e01d34" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5457bb-22bf-49fb-9879-807d1d194bfe]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] Creating offline snapshot a90cf2b2-ac46-49db-90bb-80e32627731f of volume cde827b0-eca5-4e18-80db-66147c7787bc {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6cfa3e-24ed-4d15-b199-b669a56a3bb5]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:22 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 Jul 31 11:03:22 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:22 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc Jul 31 11:03:22 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:22 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34" returned: 0 in 0.366s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:22 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc" returned: 0 in 0.416s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:22 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 Jul 31 11:03:22 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:22 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f 1G Jul 31 11:03:22 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:22 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34" returned: 1 in 0.402s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:22 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34 Jul 31 11:03:22 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:22 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f 1G" returned: 0 in 0.500s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde827b0-eca5-4e18-80db-66147c7787bc -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:22 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde827b0-eca5-4e18-80db-66147c7787bc -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f Jul 31 11:03:22 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:23 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ddc67289-1021-405e-b558-b0f721e01d34" returned: 0 in 0.387s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Lock "cinder-quobyte-ddc67289-1021-405e-b558-b0f721e01d34" released by "delete_volume" :: held 1.253s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Created reservations ['a21dba8c-c062-47b5-a64c-a72a61760702', '02fa19e0-1047-410d-a21c-f1124bca5d5a', '34668829-ebae-4d21-83cd-be665ebbc453', '63cd3a13-0aa0-48c5-b3f8-88a2bcf3aeca'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:23 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:23 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:23 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde827b0-eca5-4e18-80db-66147c7787bc -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f" returned: 0 in 0.411s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:23 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f is being set with open permissions: ugo+rw Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:23 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f Jul 31 11:03:23 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:23 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.307s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:23 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Deleted volume successfully. Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-74afba60-0323-4083-8b82-bbf8c8d2446a tempest-VolumeImageDependencyTests-540052007 None] Lock "cinder-ddc67289-1021-405e-b558-b0f721e01d34-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:23 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f" returned: 0 in 0.346s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:23 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.info Jul 31 11:03:23 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:23 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.info" returned: 0 in 0.285s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:23 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.info is being set with open permissions: ugo+rw Jul 31 11:03:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:24 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.info Jul 31 11:03:24 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:24 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.info" returned: 0 in 0.377s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.449s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:24 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-472bc690-9680-4a62-8048-3ff6c642fe8e tempest-VolumesDeleteCascade-606679403 None] Create snapshot completed successfully Jul 31 11:03:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] Creating offline snapshot d529d043-d53f-403f-9de9-632d54fd2632 of volume cde827b0-eca5-4e18-80db-66147c7787bc {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:03:25 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e659df-95d2-489c-8986-9d3afe2c228c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:25 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f Jul 31 11:03:25 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f" returned: 0 in 0.519s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cde827b0-eca5-4e18-80db-66147c7787bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:26 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:26 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 1G Jul 31 11:03:26 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:26 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 1G" returned: 0 in 0.651s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:26 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 Jul 31 11:03:26 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:27 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632" returned: 0 in 0.359s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:27 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 is being set with open permissions: ugo+rw Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:27 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 Jul 31 11:03:27 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:27 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632" returned: 0 in 0.285s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:27 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2fb869eb-836e-4844-b700-e6d786bcaf4f tempest-VolumesDeleteCascade-606679403 None] Create snapshot completed successfully Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-cde827b0-eca5-4e18-80db-66147c7787bc-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-cde827b0-eca5-4e18-80db-66147c7787bc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Performing cascade delete. {{(pid=89145) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-a90cf2b2-ac46-49db-90bb-80e32627731f-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-a90cf2b2-ac46-49db-90bb-80e32627731f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-quobyte-cde827b0-eca5-4e18-80db-66147c7787bc" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-cde827b0-eca5-4e18-80db-66147c7787bc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-quobyte-a90cf2b2-ac46-49db-90bb-80e32627731f" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-a90cf2b2-ac46-49db-90bb-80e32627731f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Deleting offline snapshot a90cf2b2-ac46-49db-90bb-80e32627731f of volume cde827b0-eca5-4e18-80db-66147c7787bc {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] snapshot_file for this snap is: volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dfaaa2-9f5d-4bb2-a3d3-d9f43bf79bfe]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:27 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f Jul 31 11:03:27 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:28 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f" returned: 0 in 0.374s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cde827b0-eca5-4e18-80db-66147c7787bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:28 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc60201-9d6d-4471-97a1-9d04f9466c13]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:28 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc Jul 31 11:03:28 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:28 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc" returned: 0 in 0.377s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:28 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc910633-f7cf-4e95-b266-68be25d5c30c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:28 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 Jul 31 11:03:28 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Flow 'volume_create_manager' (287a5075-9232-4a73-a3db-4b173db2a7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c5d4cb-48be-4c05-9522-4de2f94a872c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c5d4cb-48be-4c05-9522-4de2f94a872c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-800116510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb29960-8f65-442d-a234-507ceaa92cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa738af1f0c4a059abae8cc062bf056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:29Z,use_quota=True,user_id='0eaf86762d6c44d68e9cc8eb7ef60028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da89897-1ebf-4995-9c7f-6176a42a3b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da89897-1ebf-4995-9c7f-6176a42a3b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9a82ca-67f1-4ed0-ad65-1477b7617fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9a82ca-67f1-4ed0-ad65-1477b7617fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eb29960-8f65-442d-a234-507ceaa92cf8', 'volume_name': 'volume-4eb29960-8f65-442d-a234-507ceaa92cf8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:29 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff02441-324d-4d10-8242-998bce9d8725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff02441-324d-4d10-8242-998bce9d8725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f865a87-bdde-4fcb-80f1-e89d3d9bacab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:29 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Volume 4eb29960-8f65-442d-a234-507ceaa92cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eb29960-8f65-442d-a234-507ceaa92cf8', 'volume_size': 1} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-800116510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb29960-8f65-442d-a234-507ceaa92cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa738af1f0c4a059abae8cc062bf056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:29Z,use_quota=True,user_id='0eaf86762d6c44d68e9cc8eb7ef60028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Creating volume 4eb29960-8f65-442d-a234-507ceaa92cf8 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:29 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4eb29960-8f65-442d-a234-507ceaa92cf8 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632" returned: 0 in 0.432s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cde827b0-eca5-4e18-80db-66147c7787bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b8a0ff-b504-4e5a-92c8-5c16fc9aab11]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:29 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4eb29960-8f65-442d-a234-507ceaa92cf8 1073741824 Jul 31 11:03:29 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:29 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f Jul 31 11:03:29 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:29 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f" returned: 0 in 0.371s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cde827b0-eca5-4e18-80db-66147c7787bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd692b79-3f14-4d8c-a4c7-7f1902169e2d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:29 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4eb29960-8f65-442d-a234-507ceaa92cf8 1073741824" returned: 0 in 0.434s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4eb29960-8f65-442d-a234-507ceaa92cf8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:29 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4eb29960-8f65-442d-a234-507ceaa92cf8 Jul 31 11:03:29 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:29 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc Jul 31 11:03:29 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:29 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4eb29960-8f65-442d-a234-507ceaa92cf8" returned: 0 in 0.245s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f865a87-bdde-4fcb-80f1-e89d3d9bacab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb29960-8f65-442d-a234-507ceaa92cf8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0957647-710e-4886-8364-0f913190ae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:29 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Volume volume-4eb29960-8f65-442d-a234-507ceaa92cf8 (4eb29960-8f65-442d-a234-507ceaa92cf8): created successfully Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0957647-710e-4886-8364-0f913190ae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Flow 'volume_create_manager' (287a5075-9232-4a73-a3db-4b173db2a7e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-cc5d6dda-b88f-4248-bbf1-59e3a538ce7c tempest-ProjectReaderTests-935245493 None] Created volume successfully. Jul 31 11:03:29 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc" returned: 0 in 0.410s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:29 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f Jul 31 11:03:29 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Acquiring lock "cinder-4eb29960-8f65-442d-a234-507ceaa92cf8-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Lock "cinder-4eb29960-8f65-442d-a234-507ceaa92cf8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Acquiring lock "cinder-quobyte-4eb29960-8f65-442d-a234-507ceaa92cf8" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Lock "cinder-quobyte-4eb29960-8f65-442d-a234-507ceaa92cf8" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:30 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f" returned: 0 in 0.401s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6b5e79-ff25-40bb-a816-cae44b6963c2]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4eb29960-8f65-442d-a234-507ceaa92cf8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:30 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f Jul 31 11:03:30 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:30 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4eb29960-8f65-442d-a234-507ceaa92cf8 Jul 31 11:03:30 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:30 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.a90cf2b2-ac46-49db-90bb-80e32627731f" returned: 0 in 0.255s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde827b0-eca5-4e18-80db-66147c7787bc /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 -F qcow2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:30 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde827b0-eca5-4e18-80db-66147c7787bc /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 -F qcow2 Jul 31 11:03:30 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:30 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4eb29960-8f65-442d-a234-507ceaa92cf8" returned: 0 in 0.360s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4eb29960-8f65-442d-a234-507ceaa92cf8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:30 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4eb29960-8f65-442d-a234-507ceaa92cf8 Jul 31 11:03:30 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:30 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde827b0-eca5-4e18-80db-66147c7787bc /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 -F qcow2" returned: 0 in 0.281s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-a90cf2b2-ac46-49db-90bb-80e32627731f" released by "_delete_snapshot" :: held 3.103s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-cde827b0-eca5-4e18-80db-66147c7787bc" released by "delete_snapshot" :: held 3.135s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:30 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4eb29960-8f65-442d-a234-507ceaa92cf8" returned: 0 in 0.256s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Lock "cinder-quobyte-4eb29960-8f65-442d-a234-507ceaa92cf8" released by "delete_volume" :: held 0.662s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Created reservations ['7e8ad3f9-d0f7-4fc2-8cad-a8013a08ebe8', 'd27fbf82-cbb2-4349-bdc5-bfe85d62aa01', 'be5fbc03-9a5b-4312-8b44-dcb2ab409b09', '3db2999c-392f-4c3f-992d-7137a28588a3'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Created reservations ['3a190123-cdf6-4b70-804c-009df30f451a', '4e5a49d3-952b-46fe-b038-71267636eb78', '3585528a-9068-4c81-851d-8ed6922bbee8', '5fa5838f-e7cd-47f9-bfd2-7048f5fc349c'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:31 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Delete snapshot completed successfully. Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-a90cf2b2-ac46-49db-90bb-80e32627731f-delete_snapshot" released by "delete_snapshot" :: held 3.345s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-d529d043-d53f-403f-9de9-632d54fd2632-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-d529d043-d53f-403f-9de9-632d54fd2632-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-quobyte-cde827b0-eca5-4e18-80db-66147c7787bc" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-cde827b0-eca5-4e18-80db-66147c7787bc" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-quobyte-d529d043-d53f-403f-9de9-632d54fd2632" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-d529d043-d53f-403f-9de9-632d54fd2632" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:31 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Deleting offline snapshot d529d043-d53f-403f-9de9-632d54fd2632 of volume cde827b0-eca5-4e18-80db-66147c7787bc {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:03:31 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] snapshot_file for this snap is: volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca33c66-2a4c-4a27-b85b-9dfdd28e51d0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:31 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 Jul 31 11:03:31 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:31 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.314s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:31 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Deleted volume successfully. Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39555c74-cd3f-499e-8df9-c19837c576e6 tempest-ProjectReaderTests-935245493 None] Lock "cinder-4eb29960-8f65-442d-a234-507ceaa92cf8-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:31 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632" returned: 0 in 0.413s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cde827b0-eca5-4e18-80db-66147c7787bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3806c3c7-9416-4e76-871f-0545b722a2ef]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:31 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc Jul 31 11:03:31 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Flow 'volume_create_manager' (cc61c344-f6bf-4660-8652-bd18ecba65f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb13064-cd90-444b-8814-fd0cdd492be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb13064-cd90-444b-8814-fd0cdd492be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267678685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e869a05a-4ae3-442f-bb67-9c4c2f77d3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa738af1f0c4a059abae8cc062bf056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:32Z,use_quota=True,user_id='0eaf86762d6c44d68e9cc8eb7ef60028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f3b254-0bf7-4c3b-a615-f763998b0d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f3b254-0bf7-4c3b-a615-f763998b0d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf86a12-8bf7-4e63-ac6d-932294949483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf86a12-8bf7-4e63-ac6d-932294949483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e869a05a-4ae3-442f-bb67-9c4c2f77d3dc', 'volume_name': 'volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc52f202-1b93-40e0-b1e3-1188a4eb5033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc52f202-1b93-40e0-b1e3-1188a4eb5033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476c457b-3cbb-49b7-b3d1-07db8a3347a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:32 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Volume e869a05a-4ae3-442f-bb67-9c4c2f77d3dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc', 'volume_size': 1} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267678685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e869a05a-4ae3-442f-bb67-9c4c2f77d3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa738af1f0c4a059abae8cc062bf056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:32Z,use_quota=True,user_id='0eaf86762d6c44d68e9cc8eb7ef60028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Creating volume e869a05a-4ae3-442f-bb67-9c4c2f77d3dc {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:32 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:32 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc" returned: 0 in 0.421s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:32 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc 1073741824 Jul 31 11:03:32 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:32 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 Jul 31 11:03:32 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:32 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632" returned: 0 in 0.471s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:32 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc 1073741824" returned: 0 in 0.508s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:32 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632 Jul 31 11:03:32 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:32 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc Jul 31 11:03:32 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:32 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc.d529d043-d53f-403f-9de9-632d54fd2632" returned: 0 in 0.342s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:32 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc" returned: 0 in 0.309s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-d529d043-d53f-403f-9de9-632d54fd2632" released by "_delete_snapshot" :: held 1.773s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476c457b-3cbb-49b7-b3d1-07db8a3347a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72918951-a362-44fd-b0d0-5bb8526b49ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-cde827b0-eca5-4e18-80db-66147c7787bc" released by "delete_snapshot" :: held 1.814s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:33 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Volume volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc (e869a05a-4ae3-442f-bb67-9c4c2f77d3dc): created successfully Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72918951-a362-44fd-b0d0-5bb8526b49ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Flow 'volume_create_manager' (cc61c344-f6bf-4660-8652-bd18ecba65f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:33 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ce34ae20-7f23-4b0c-a345-dd1052103e0d tempest-ProjectReaderTests-935245493 None] Created volume successfully. Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Created reservations ['db0c28ba-effd-41ef-8953-55c2b4726352', '22f20ceb-8d6c-4ec9-913d-f3433f47f59d', '876198f1-d293-471c-b7cb-3785654b4d23', '18dd1ed9-dcca-4996-9d47-213a9d3f587d'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:33 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Delete snapshot completed successfully. Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-d529d043-d53f-403f-9de9-632d54fd2632-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Snapshots deleted, issuing volume delete {{(pid=89145) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-quobyte-cde827b0-eca5-4e18-80db-66147c7787bc" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-cde827b0-eca5-4e18-80db-66147c7787bc" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1b85e5-e039-4d68-be58-a7ab457b13cf]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:33 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc Jul 31 11:03:33 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:33 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc" returned: 0 in 0.392s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:33 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc Jul 31 11:03:33 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:33 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cde827b0-eca5-4e18-80db-66147c7787bc" returned: 0 in 0.268s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-cde827b0-eca5-4e18-80db-66147c7787bc" released by "delete_volume" :: held 0.730s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Created reservations ['ef8d45f2-45b3-4d22-83e4-1616fa1d9c3b', '04eb25e1-b24e-49a2-9f02-9e9071d9bf58', '9707b5d3-594d-46dd-98b5-2fd5750a7a19', 'af621aab-a81c-4b8e-bf60-e73beaf1b69a'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Acquiring lock "cinder-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:34 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Lock "cinder-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:34 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Acquiring lock "cinder-quobyte-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Lock "cinder-quobyte-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc" acquired by "delete_volume" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad44263d-9b0f-4f79-a767-c06f2f110cda]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:34 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc Jul 31 11:03:34 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:34 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.392s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:34 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Deleted volume successfully. Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7f207e42-b9d6-4bd7-aa13-102beb7ff259 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-cde827b0-eca5-4e18-80db-66147c7787bc-delete_volume" released by "delete_volume" :: held 6.904s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:34 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc" returned: 0 in 0.512s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:34 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc Jul 31 11:03:34 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Flow 'volume_create_manager' (7f1bd37d-f042-4bd3-b411-279dc83c2e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac76c0a-ec1a-412a-9f53-541a4b78c93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac76c0a-ec1a-412a-9f53-541a4b78c93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-430624027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2c830a-cb3a-46aa-955b-2a7b3a26c36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198445eb4eed47a88361bd4312df9c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:35Z,use_quota=True,user_id='5cd96d9b6b2a4d57bb9d3bbe7c8f2b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf89f19b-8aba-40cc-82eb-445ba453efce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf89f19b-8aba-40cc-82eb-445ba453efce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:35 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909c5e2f-0f94-4f7e-aa23-5919918562d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909c5e2f-0f94-4f7e-aa23-5919918562d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba2c830a-cb3a-46aa-955b-2a7b3a26c36c', 'volume_name': 'volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d64b94-5493-44c2-ab75-331cda8141ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d64b94-5493-44c2-ab75-331cda8141ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8482e905-a59f-4242-856e-28424902a957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:35 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Volume ba2c830a-cb3a-46aa-955b-2a7b3a26c36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c', 'volume_size': 1} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-430624027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2c830a-cb3a-46aa-955b-2a7b3a26c36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198445eb4eed47a88361bd4312df9c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:35Z,use_quota=True,user_id='5cd96d9b6b2a4d57bb9d3bbe7c8f2b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Creating volume ba2c830a-cb3a-46aa-955b-2a7b3a26c36c {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:35 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc" returned: 0 in 0.324s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:35 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c 1073741824 Jul 31 11:03:35 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Lock "cinder-quobyte-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc" released by "delete_volume" :: held 0.905s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Created reservations ['8b45c7b9-49e4-4a58-8c7a-d839ea508e92', '15efbc6d-fde5-4e7c-8807-5fa34f59d614', 'f3d70e68-937d-4ef5-acf5-36e797fe969f', '4b446947-7b3f-495e-85c0-e1c8facce6a7'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:35 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:35 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:35 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.340s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:35 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Deleted volume successfully. Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-53b1d3d4-002c-4f51-8eda-39d0f21eaba2 tempest-ProjectReaderTests-935245493 None] Lock "cinder-e869a05a-4ae3-442f-bb67-9c4c2f77d3dc-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:35 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c 1073741824" returned: 0 in 0.590s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:35 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c Jul 31 11:03:35 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:36 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" returned: 0 in 0.352s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8482e905-a59f-4242-856e-28424902a957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c68223-c8ce-4b80-8d24-d62b79e9941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:36 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Volume volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c (ba2c830a-cb3a-46aa-955b-2a7b3a26c36c): created successfully Jul 31 11:03:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c68223-c8ce-4b80-8d24-d62b79e9941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Flow 'volume_create_manager' (7f1bd37d-f042-4bd3-b411-279dc83c2e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:36 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-627c17ed-f67d-4d24-864f-d7be66d8629e tempest-VolumesDeleteCascade-606679403 None] Created volume successfully. Jul 31 11:03:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] Creating offline snapshot a28f8052-b2c2-4b70-8ca6-bd48755a7155 of volume ba2c830a-cb3a-46aa-955b-2a7b3a26c36c {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:03:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d96d62-2e38-4a13-b6e4-701aeabffed3]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:37 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c Jul 31 11:03:37 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:37 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" returned: 0 in 0.373s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:37 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 1G Jul 31 11:03:37 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:38 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 1G" returned: 0 in 0.394s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:38 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 Jul 31 11:03:38 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:38 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155" returned: 0 in 0.291s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:38 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 is being set with open permissions: ugo+rw Jul 31 11:03:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:38 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 Jul 31 11:03:38 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:38 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155" returned: 0 in 0.229s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:38 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.info Jul 31 11:03:38 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:38 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.info" returned: 0 in 0.274s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:38 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.info is being set with open permissions: ugo+rw Jul 31 11:03:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:38 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.info Jul 31 11:03:38 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:39 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.info" returned: 0 in 0.243s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b56933e8-a7dd-440a-a693-cfbb2d9c46e4 tempest-VolumesDeleteCascade-606679403 None] Create snapshot completed successfully Jul 31 11:03:39 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Flow 'volume_create_manager' (3fb498d3-4116-4ed6-9832-66cd20c19104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f22d0e4-62e2-40a6-8f6e-155bc3c65ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f22d0e4-62e2-40a6-8f6e-155bc3c65ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-466970873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f20acac-f3ad-4ee2-bc44-98b17df3ab55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198445eb4eed47a88361bd4312df9c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a28f8052-b2c2-4b70-8ca6-bd48755a7155,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:40Z,use_quota=True,user_id='5cd96d9b6b2a4d57bb9d3bbe7c8f2b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3033d3-7a9b-47d6-95e2-331e79b3f07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3033d3-7a9b-47d6-95e2-331e79b3f07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e468c785-73b6-4a11-9e1a-eb95328f54d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e468c785-73b6-4a11-9e1a-eb95328f54d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f20acac-f3ad-4ee2-bc44-98b17df3ab55', 'volume_name': 'volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55', 'volume_size': 1, 'snapshot_id': 'a28f8052-b2c2-4b70-8ca6-bd48755a7155'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4892fb09-5bb9-422e-b27a-c0c2cb7a0d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4892fb09-5bb9-422e-b27a-c0c2cb7a0d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a82787-3b28-4e09-8fbd-271fa1d0263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:40 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Volume 4f20acac-f3ad-4ee2-bc44-98b17df3ab55: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55', 'volume_size': 1, 'snapshot_id': 'a28f8052-b2c2-4b70-8ca6-bd48755a7155'} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-quobyte-a28f8052-b2c2-4b70-8ca6-bd48755a7155-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" by "_create_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-a28f8052-b2c2-4b70-8ca6-bd48755a7155-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Creating volume 4f20acac-f3ad-4ee2-bc44-98b17df3ab55 from snapshot a28f8052-b2c2-4b70-8ca6-bd48755a7155 {{(pid=89145) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-quobyte-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" by "_copy_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] snapshot: a28f8052-b2c2-4b70-8ca6-bd48755a7155, volume: 4f20acac-f3ad-4ee2-bc44-98b17df3ab55, {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72b009b-1240-4096-a8ca-718b6be09ee4]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:40 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 Jul 31 11:03:40 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:40 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155" returned: 0 in 0.379s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Creating direct copy from snapshot {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[14065940-bfe4-4663-9ba3-cc6e7190aef2]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:40 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c Jul 31 11:03:40 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:40 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" returned: 0 in 0.370s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG cinder.utils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Path /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55 not found in is_blk_device check {{(pid=89145) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:03:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:40 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55 Jul 31 11:03:40 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:45 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" returned: 0 in 4.882s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:45 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2886093-a561-4fb7-89f0-5033c7658261]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:45 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c Jul 31 11:03:45 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:46 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" returned: 0 in 0.563s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55 {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:03:46 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Converted 1024.00 MB image at 209.68 MB/s Jul 31 11:03:46 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55 is being set with open permissions: ugo+rw Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:46 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55 Jul 31 11:03:46 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Flow 'volume_create_manager' (d3bac75f-d75f-4c5f-9363-87a73b0ce55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd65584-550c-4f3f-81f4-4049e49816f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd65584-550c-4f3f-81f4-4049e49816f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1351857113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e45a63-ef62-42ba-b215-c54004fd5ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346c40841dd243d298ea0394c03edb8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:47Z,use_quota=True,user_id='0894b85c7380474788c3bf6b9102bfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a33aef0-4639-4d86-9171-1192459139ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a33aef0-4639-4d86-9171-1192459139ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d51aa77-8044-4ea3-99b1-c30187470eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d51aa77-8044-4ea3-99b1-c30187470eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e45a63-ef62-42ba-b215-c54004fd5ef2', 'volume_name': 'volume-35e45a63-ef62-42ba-b215-c54004fd5ef2', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e7a795-265c-49f8-9afd-5ca6c26bffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e7a795-265c-49f8-9afd-5ca6c26bffbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a08285-4756-455f-b111-6917668847fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:46 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Volume 35e45a63-ef62-42ba-b215-c54004fd5ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e45a63-ef62-42ba-b215-c54004fd5ef2', 'volume_size': 1} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:46 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" returned: 0 in 0.338s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" released by "_copy_volume_from_snapshot" :: held 6.643s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-a28f8052-b2c2-4b70-8ca6-bd48755a7155-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" released by "_create_volume_from_snapshot" :: held 6.689s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.707s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1351857113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e45a63-ef62-42ba-b215-c54004fd5ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346c40841dd243d298ea0394c03edb8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:47Z,use_quota=True,user_id='0894b85c7380474788c3bf6b9102bfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Creating volume 35e45a63-ef62-42ba-b215-c54004fd5ef2 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:46 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35e45a63-ef62-42ba-b215-c54004fd5ef2 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:46 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35e45a63-ef62-42ba-b215-c54004fd5ef2 1073741824 Jul 31 11:03:46 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a82787-3b28-4e09-8fbd-271fa1d0263f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55', 'volume_size': 1, 'snapshot_id': 'a28f8052-b2c2-4b70-8ca6-bd48755a7155'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c786847-4629-498c-be5b-cc181200652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:46 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Volume volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55 (4f20acac-f3ad-4ee2-bc44-98b17df3ab55): created successfully Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c786847-4629-498c-be5b-cc181200652c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Flow 'volume_create_manager' (3fb498d3-4116-4ed6-9832-66cd20c19104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:46 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ce99a2cf-c71c-4055-b429-1456262dac14 tempest-VolumesDeleteCascade-606679403 None] Created volume successfully. Jul 31 11:03:47 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35e45a63-ef62-42ba-b215-c54004fd5ef2 1073741824" returned: 0 in 0.437s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35e45a63-ef62-42ba-b215-c54004fd5ef2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:47 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35e45a63-ef62-42ba-b215-c54004fd5ef2 Jul 31 11:03:47 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:47 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35e45a63-ef62-42ba-b215-c54004fd5ef2" returned: 0 in 0.242s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a08285-4756-455f-b111-6917668847fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e45a63-ef62-42ba-b215-c54004fd5ef2', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a42e94-28d5-4bb5-aa17-be85b974b417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:47 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Volume volume-35e45a63-ef62-42ba-b215-c54004fd5ef2 (35e45a63-ef62-42ba-b215-c54004fd5ef2): created successfully Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a42e94-28d5-4bb5-aa17-be85b974b417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Flow 'volume_create_manager' (d3bac75f-d75f-4c5f-9363-87a73b0ce55b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:47 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9c8b2ad5-098a-41de-a5d3-51a9325e881b tempest-ProjectReaderTests-283854032 None] Created volume successfully. Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Acquiring lock "cinder-35e45a63-ef62-42ba-b215-c54004fd5ef2-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Lock "cinder-35e45a63-ef62-42ba-b215-c54004fd5ef2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Acquiring lock "cinder-quobyte-35e45a63-ef62-42ba-b215-c54004fd5ef2" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Lock "cinder-quobyte-35e45a63-ef62-42ba-b215-c54004fd5ef2" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa5e8e3-d262-4fc2-a335-d794f0d14cb0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35e45a63-ef62-42ba-b215-c54004fd5ef2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Performing cascade delete. {{(pid=89145) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-a28f8052-b2c2-4b70-8ca6-bd48755a7155-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-a28f8052-b2c2-4b70-8ca6-bd48755a7155-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-quobyte-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" acquired by "delete_snapshot" :: waited 0.012s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-quobyte-a28f8052-b2c2-4b70-8ca6-bd48755a7155" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-a28f8052-b2c2-4b70-8ca6-bd48755a7155" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Deleting offline snapshot a28f8052-b2c2-4b70-8ca6-bd48755a7155 of volume ba2c830a-cb3a-46aa-955b-2a7b3a26c36c {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:03:48 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35e45a63-ef62-42ba-b215-c54004fd5ef2 Jul 31 11:03:48 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] snapshot_file for this snap is: volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d07b8ef-e91e-4be5-8f39-769019d3c1a8]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:48 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 Jul 31 11:03:48 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:48 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35e45a63-ef62-42ba-b215-c54004fd5ef2" returned: 0 in 0.396s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35e45a63-ef62-42ba-b215-c54004fd5ef2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:48 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35e45a63-ef62-42ba-b215-c54004fd5ef2 Jul 31 11:03:48 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:48 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155" returned: 0 in 0.410s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeed0575-26d8-4e43-bb70-d1d987b1fdb4]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:48 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35e45a63-ef62-42ba-b215-c54004fd5ef2" returned: 0 in 0.252s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Lock "cinder-quobyte-35e45a63-ef62-42ba-b215-c54004fd5ef2" released by "delete_volume" :: held 0.706s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Created reservations ['daed46f8-b5ad-4a94-bad3-5d95e57dd4d4', 'dfbfca84-4606-42d1-bd5b-8f34cfca4ada', '4b326593-0bbc-4e57-ab6a-032a9eab8382', 'b46bbb99-6856-40dd-8928-b8e5e745889c'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:48 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c Jul 31 11:03:48 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:48 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:48 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:48 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" returned: 0 in 0.477s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:49 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.319s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:49 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Deleted volume successfully. Jul 31 11:03:49 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 Jul 31 11:03:49 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7c564fe3-e763-44d2-b1da-948827fe713f tempest-ProjectReaderTests-283854032 None] Lock "cinder-35e45a63-ef62-42ba-b215-c54004fd5ef2-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:49 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155" returned: 0 in 0.492s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:49 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155 Jul 31 11:03:49 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Flow 'volume_create_manager' (ae78ce83-9919-4efb-953b-408b8d0f7f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcaaf171-e455-4952-ba7f-5b4d88507e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcaaf171-e455-4952-ba7f-5b4d88507e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2083867106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35061323-5816-4e01-974d-8c3841f64da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346c40841dd243d298ea0394c03edb8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:50Z,use_quota=True,user_id='0894b85c7380474788c3bf6b9102bfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f21b6f4-3131-49e5-a1d7-944ca37ab2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f21b6f4-3131-49e5-a1d7-944ca37ab2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8eff46-248f-4eda-abd9-723caaa2e7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8eff46-248f-4eda-abd9-723caaa2e7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35061323-5816-4e01-974d-8c3841f64da2', 'volume_name': 'volume-35061323-5816-4e01-974d-8c3841f64da2', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f54f059-0e2c-40e7-8229-e997f1abe1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f54f059-0e2c-40e7-8229-e997f1abe1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee82869-44c7-49d0-9b80-942ded213a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:49 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Volume 35061323-5816-4e01-974d-8c3841f64da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35061323-5816-4e01-974d-8c3841f64da2', 'volume_size': 1} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2083867106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35061323-5816-4e01-974d-8c3841f64da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346c40841dd243d298ea0394c03edb8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:50Z,use_quota=True,user_id='0894b85c7380474788c3bf6b9102bfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Creating volume 35061323-5816-4e01-974d-8c3841f64da2 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:49 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35061323-5816-4e01-974d-8c3841f64da2 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:49 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35061323-5816-4e01-974d-8c3841f64da2 1073741824 Jul 31 11:03:49 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:49 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c.a28f8052-b2c2-4b70-8ca6-bd48755a7155" returned: 0 in 0.275s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-a28f8052-b2c2-4b70-8ca6-bd48755a7155" released by "_delete_snapshot" :: held 1.763s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" released by "delete_snapshot" :: held 1.791s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Created reservations ['2d8c251b-6fca-43f1-899c-4340cbfc56a1', '86dfbc1f-a53c-4ffa-807a-23aa233102d9', 'fc387521-a5b4-49df-8a9a-90c5799647a6', 'a580f0ad-433e-46c5-b322-fc470f8d53bc'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:49 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Delete snapshot completed successfully. Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-a28f8052-b2c2-4b70-8ca6-bd48755a7155-delete_snapshot" released by "delete_snapshot" :: held 1.957s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Snapshots deleted, issuing volume delete {{(pid=89145) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-quobyte-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b643470d-595e-4ce3-8e91-c8f59002f5d5]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:50 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c Jul 31 11:03:50 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:50 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35061323-5816-4e01-974d-8c3841f64da2 1073741824" returned: 0 in 0.499s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35061323-5816-4e01-974d-8c3841f64da2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:50 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35061323-5816-4e01-974d-8c3841f64da2 Jul 31 11:03:50 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:50 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" returned: 0 in 0.390s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:50 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c Jul 31 11:03:50 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:50 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35061323-5816-4e01-974d-8c3841f64da2" returned: 0 in 0.276s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee82869-44c7-49d0-9b80-942ded213a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35061323-5816-4e01-974d-8c3841f64da2', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f896597e-d1f1-47b7-80ff-8603cd19dede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:50 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Volume volume-35061323-5816-4e01-974d-8c3841f64da2 (35061323-5816-4e01-974d-8c3841f64da2): created successfully Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f896597e-d1f1-47b7-80ff-8603cd19dede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Flow 'volume_create_manager' (ae78ce83-9919-4efb-953b-408b8d0f7f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:50 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a05b5d76-7ab8-45a1-add0-7186549df718 tempest-ProjectReaderTests-283854032 None] Created volume successfully. Jul 31 11:03:50 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" returned: 0 in 0.321s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c" released by "delete_volume" :: held 0.770s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Created reservations ['25669fc5-3c6f-47fe-aa92-fb8cfb2ddf83', '295aa9f7-c881-4c76-b40f-7a5f3b4ac0aa', 'c97cd781-dde6-4944-8329-8145d70a9c77', '6e474b90-dfff-49b4-8af3-511492c6677b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:50 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:50 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:51 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.442s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:51 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Deleted volume successfully. Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8dea4934-4b25-4656-9d46-3d051b9e4a4a tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-ba2c830a-cb3a-46aa-955b-2a7b3a26c36c-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-4f20acac-f3ad-4ee2-bc44-98b17df3ab55-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-4f20acac-f3ad-4ee2-bc44-98b17df3ab55-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:51 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-a91cb409-008c-4743-b477-e89f722153a7 req-25eda353-4209-43ad-909e-3276897b6d01 tempest-TestShelveInstance-444766395 None] Terminate volume connection completed successfully. Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-a91cb409-008c-4743-b477-e89f722153a7 req-25eda353-4209-43ad-909e-3276897b6d01 tempest-TestShelveInstance-444766395 None] Deleting attachment ceaa5302-461b-4072-b7a9-dce35b938c30. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "cinder-quobyte-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[035c1243-7dfd-4b18-9555-81d17430f34a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:51 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55 Jul 31 11:03:51 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Acquiring lock "cinder-35061323-5816-4e01-974d-8c3841f64da2-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Lock "cinder-35061323-5816-4e01-974d-8c3841f64da2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Acquiring lock "cinder-quobyte-35061323-5816-4e01-974d-8c3841f64da2" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Lock "cinder-quobyte-35061323-5816-4e01-974d-8c3841f64da2" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ad6452-df0b-4714-9569-cdb2abc837d1]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35061323-5816-4e01-974d-8c3841f64da2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:51 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" returned: 0 in 0.451s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:51 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55 Jul 31 11:03:51 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:52 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35061323-5816-4e01-974d-8c3841f64da2 Jul 31 11:03:52 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:52 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" returned: 0 in 0.255s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-quobyte-4f20acac-f3ad-4ee2-bc44-98b17df3ab55" released by "delete_volume" :: held 0.745s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Created reservations ['51a38354-b311-4d55-81d2-5adbf6a786cf', '430c1dea-8518-4f53-b17c-415a7d81d5d6', '274c89f6-a72f-4ec5-bd0f-88509b3d1000', 'dff14c55-b031-4c48-ace9-21b74d252ceb'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:52 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35061323-5816-4e01-974d-8c3841f64da2" returned: 0 in 0.359s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35061323-5816-4e01-974d-8c3841f64da2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:52 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35061323-5816-4e01-974d-8c3841f64da2 Jul 31 11:03:52 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:52 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:52 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:52 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-35061323-5816-4e01-974d-8c3841f64da2" returned: 0 in 0.262s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Lock "cinder-quobyte-35061323-5816-4e01-974d-8c3841f64da2" released by "delete_volume" :: held 0.680s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:52 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.269s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Deleted volume successfully. Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Created reservations ['b0e783a1-f238-4062-8f13-8b4413531f52', 'abc51f1c-c5dd-4b0e-bc90-dbc382c0fd76', '3b668702-51bb-4341-bcd2-3be3ff8faf8e', '22b5f192-408d-49e4-86ef-6cb8f5f2b8a6'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3a3df72c-188e-4bf1-95f3-623f52eba8ec tempest-VolumesDeleteCascade-606679403 None] Lock "cinder-4f20acac-f3ad-4ee2-bc44-98b17df3ab55-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:52 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:52 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:53 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.305s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:53 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Deleted volume successfully. Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-13b4af38-bf1a-4f18-8d20-bddc86de6688 tempest-ProjectReaderTests-283854032 None] Lock "cinder-35061323-5816-4e01-974d-8c3841f64da2-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Flow 'volume_create_manager' (433319d9-7ac3-424d-92fc-27a7642bd399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0afbbcd1-0c9a-40b0-8035-4545e09f91e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0afbbcd1-0c9a-40b0-8035-4545e09f91e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-686327559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470297d8-2623-418d-8aa1-807a0c7cfbef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346c40841dd243d298ea0394c03edb8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:53Z,use_quota=True,user_id='0894b85c7380474788c3bf6b9102bfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b195568-518b-4844-9569-f277aec03396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b195568-518b-4844-9569-f277aec03396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e825ae-2fc8-4c18-88bf-8636e266d5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e825ae-2fc8-4c18-88bf-8636e266d5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '470297d8-2623-418d-8aa1-807a0c7cfbef', 'volume_name': 'volume-470297d8-2623-418d-8aa1-807a0c7cfbef', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49570358-cabc-4fe2-957b-622794bb0cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49570358-cabc-4fe2-957b-622794bb0cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1dcb832-f2b8-4d43-8900-795afed3602c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:53 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Volume 470297d8-2623-418d-8aa1-807a0c7cfbef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-470297d8-2623-418d-8aa1-807a0c7cfbef', 'volume_size': 1} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-686327559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470297d8-2623-418d-8aa1-807a0c7cfbef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346c40841dd243d298ea0394c03edb8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:53Z,use_quota=True,user_id='0894b85c7380474788c3bf6b9102bfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Creating volume 470297d8-2623-418d-8aa1-807a0c7cfbef {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:53 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:03:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-470297d8-2623-418d-8aa1-807a0c7cfbef 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:53 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-470297d8-2623-418d-8aa1-807a0c7cfbef 1073741824 Jul 31 11:03:53 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:54 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-470297d8-2623-418d-8aa1-807a0c7cfbef 1073741824" returned: 0 in 0.511s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-470297d8-2623-418d-8aa1-807a0c7cfbef {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:54 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-470297d8-2623-418d-8aa1-807a0c7cfbef Jul 31 11:03:54 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:54 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-470297d8-2623-418d-8aa1-807a0c7cfbef" returned: 0 in 0.265s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1dcb832-f2b8-4d43-8900-795afed3602c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470297d8-2623-418d-8aa1-807a0c7cfbef', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c864f4c6-bb7b-4dd3-9506-11af9eb20377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:54 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Volume volume-470297d8-2623-418d-8aa1-807a0c7cfbef (470297d8-2623-418d-8aa1-807a0c7cfbef): created successfully Jul 31 11:03:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c864f4c6-bb7b-4dd3-9506-11af9eb20377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Flow 'volume_create_manager' (433319d9-7ac3-424d-92fc-27a7642bd399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:54 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2ec6a1af-69a0-4597-bb62-78d190ab023c tempest-ProjectReaderTests-283854032 None] Created volume successfully. Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-88af1a41-174b-4379-b9e8-00e58b4ecda6 req-c0b4a9af-eedc-4cd6-9c2f-398c7586baf6 tempest-TestShelveInstance-444766395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-88af1a41-174b-4379-b9e8-00e58b4ecda6 req-c0b4a9af-eedc-4cd6-9c2f-398c7586baf6 tempest-TestShelveInstance-444766395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb843a9-9816-4b99-8d84-1b49fcd71d5d]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-88af1a41-174b-4379-b9e8-00e58b4ecda6 req-c0b4a9af-eedc-4cd6-9c2f-398c7586baf6 tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:55 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 Jul 31 11:03:55 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:55 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-88af1a41-174b-4379-b9e8-00e58b4ecda6 req-c0b4a9af-eedc-4cd6-9c2f-398c7586baf6 tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113" returned: 0 in 0.354s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-88af1a41-174b-4379-b9e8-00e58b4ecda6 req-c0b4a9af-eedc-4cd6-9c2f-398c7586baf6 tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:55 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 Jul 31 11:03:55 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Acquiring lock "cinder-470297d8-2623-418d-8aa1-807a0c7cfbef-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Lock "cinder-470297d8-2623-418d-8aa1-807a0c7cfbef-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Acquiring lock "cinder-quobyte-470297d8-2623-418d-8aa1-807a0c7cfbef" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Lock "cinder-quobyte-470297d8-2623-418d-8aa1-807a0c7cfbef" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6652b19-2c63-4a18-8e48-ebcbbf2809e6]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-470297d8-2623-418d-8aa1-807a0c7cfbef {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:55 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-88af1a41-174b-4379-b9e8-00e58b4ecda6 req-c0b4a9af-eedc-4cd6-9c2f-398c7586baf6 tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113" returned: 1 in 0.376s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-88af1a41-174b-4379-b9e8-00e58b4ecda6 req-c0b4a9af-eedc-4cd6-9c2f-398c7586baf6 tempest-TestShelveInstance-444766395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-88af1a41-174b-4379-b9e8-00e58b4ecda6 req-c0b4a9af-eedc-4cd6-9c2f-398c7586baf6 tempest-TestShelveInstance-444766395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.772s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-88af1a41-174b-4379-b9e8-00e58b4ecda6 req-c0b4a9af-eedc-4cd6-9c2f-398c7586baf6 tempest-TestShelveInstance-444766395 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-ec27cda6-40bd-4862-a6a8-d3af171b0113', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17825d7d-c7bd-4245-bfd7-490db1dfb0a3', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:03:55 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-470297d8-2623-418d-8aa1-807a0c7cfbef Jul 31 11:03:55 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:55 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-88af1a41-174b-4379-b9e8-00e58b4ecda6 req-c0b4a9af-eedc-4cd6-9c2f-398c7586baf6 tempest-TestShelveInstance-444766395 None] attachment_update completed successfully. Jul 31 11:03:56 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-470297d8-2623-418d-8aa1-807a0c7cfbef" returned: 0 in 0.467s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-470297d8-2623-418d-8aa1-807a0c7cfbef {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:56 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-470297d8-2623-418d-8aa1-807a0c7cfbef Jul 31 11:03:56 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:56 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-470297d8-2623-418d-8aa1-807a0c7cfbef" returned: 0 in 0.282s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Lock "cinder-quobyte-470297d8-2623-418d-8aa1-807a0c7cfbef" released by "delete_volume" :: held 0.794s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Created reservations ['abfd2e80-0416-4ab4-a4d9-ba34c7711c4a', 'd80828ed-8c54-4194-964e-01ff71a393a1', '1e40fb33-c5eb-40ab-b5dc-fb33393d4f66', 'b1130075-2cf6-4550-9e71-837b5bfbd2a4'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:56 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:03:56 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:56 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.326s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:56 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:57 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Deleted volume successfully. Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-13fef63c-d46d-4706-aac4-a9852058937e tempest-ProjectReaderTests-283854032 None] Lock "cinder-470297d8-2623-418d-8aa1-807a0c7cfbef-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Flow 'volume_create_manager' (1880b574-977b-4c30-9b29-cc20e205c629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283c5fd7-9dc8-40e8-bae0-f422c78deef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283c5fd7-9dc8-40e8-bae0-f422c78deef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1536330689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6630ea78-cbd0-4187-a4dd-c0aa745038e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346c40841dd243d298ea0394c03edb8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:57Z,use_quota=True,user_id='0894b85c7380474788c3bf6b9102bfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f6f678-e80c-4709-9b8c-9985a1fce3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f6f678-e80c-4709-9b8c-9985a1fce3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a01201-82ab-44c7-98aa-debf50e40ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a01201-82ab-44c7-98aa-debf50e40ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6630ea78-cbd0-4187-a4dd-c0aa745038e9', 'volume_name': 'volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40516f38-5ed2-4069-926b-78e38ce6ec07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40516f38-5ed2-4069-926b-78e38ce6ec07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9ba788-c711-45ed-ae09-2e806f5574bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:57 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Volume 6630ea78-cbd0-4187-a4dd-c0aa745038e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9', 'volume_size': 1} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1536330689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6630ea78-cbd0-4187-a4dd-c0aa745038e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='346c40841dd243d298ea0394c03edb8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:57Z,use_quota=True,user_id='0894b85c7380474788c3bf6b9102bfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Creating volume 6630ea78-cbd0-4187-a4dd-c0aa745038e9 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:57 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:57 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9 1073741824 Jul 31 11:03:57 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Flow 'volume_create_manager' (309c33bf-716a-4b6e-93bd-aaba15542104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34356430-7620-4ad5-89d0-0d296e23f5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34356430-7620-4ad5-89d0-0d296e23f5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-737753129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5fee85-ca8f-475b-8868-e3b850fd4baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c81244f0bd4a4ab721dedebc075888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:58Z,use_quota=True,user_id='a8c9532f85f34f73814a76fe5f3bb154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4474cbec-5c81-4215-a0f8-16925c303811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4474cbec-5c81-4215-a0f8-16925c303811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2040086-64e5-44e9-9f45-4bf4b17af4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2040086-64e5-44e9-9f45-4bf4b17af4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5fee85-ca8f-475b-8868-e3b850fd4baa', 'volume_name': 'volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a8c21f-4f74-4fb5-8196-8d8b3490d20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a8c21f-4f74-4fb5-8196-8d8b3490d20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28cad797-f66e-4941-b6d1-7cfe556d72c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:57 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Volume 3b5fee85-ca8f-475b-8868-e3b850fd4baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa', 'volume_size': 1} Jul 31 11:03:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:58 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9 1073741824" returned: 0 in 0.608s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:58 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9 Jul 31 11:03:58 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:58 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9" returned: 0 in 0.317s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-737753129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5fee85-ca8f-475b-8868-e3b850fd4baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c81244f0bd4a4ab721dedebc075888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:58Z,use_quota=True,user_id='a8c9532f85f34f73814a76fe5f3bb154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Creating volume 3b5fee85-ca8f-475b-8868-e3b850fd4baa {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:58 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:58 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa 1073741824 Jul 31 11:03:58 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9ba788-c711-45ed-ae09-2e806f5574bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b6b066-fb5b-43f0-b153-40f2f65517ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:58 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Volume volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9 (6630ea78-cbd0-4187-a4dd-c0aa745038e9): created successfully Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b6b066-fb5b-43f0-b153-40f2f65517ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Flow 'volume_create_manager' (1880b574-977b-4c30-9b29-cc20e205c629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:58 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3a15199c-a88d-476e-a8a2-9e01a14fb15c tempest-ProjectReaderTests-283854032 None] Created volume successfully. Jul 31 11:03:59 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa 1073741824" returned: 0 in 0.826s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:59 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa Jul 31 11:03:59 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Acquiring lock "cinder-6630ea78-cbd0-4187-a4dd-c0aa745038e9-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Lock "cinder-6630ea78-cbd0-4187-a4dd-c0aa745038e9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Acquiring lock "cinder-quobyte-6630ea78-cbd0-4187-a4dd-c0aa745038e9" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Lock "cinder-quobyte-6630ea78-cbd0-4187-a4dd-c0aa745038e9" acquired by "delete_volume" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5630c7-191c-4bb0-8e50-4bb3bf7a87d0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:59 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa" returned: 0 in 0.500s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28cad797-f66e-4941-b6d1-7cfe556d72c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b529c681-0169-4ee4-a4f5-d08bf0f0d9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:59 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Volume volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa (3b5fee85-ca8f-475b-8868-e3b850fd4baa): created successfully Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b529c681-0169-4ee4-a4f5-d08bf0f0d9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Flow 'volume_create_manager' (309c33bf-716a-4b6e-93bd-aaba15542104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:00 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3d47827d-7e97-429c-a93c-d2b3b7239024 tempest-VolumesTransfersV355Test-1408942273 None] Created volume successfully. Jul 31 11:04:00 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9 Jul 31 11:04:00 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:00 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9" returned: 0 in 0.401s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:00 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9 Jul 31 11:04:00 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:00 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6630ea78-cbd0-4187-a4dd-c0aa745038e9" returned: 0 in 0.257s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Lock "cinder-quobyte-6630ea78-cbd0-4187-a4dd-c0aa745038e9" released by "delete_volume" :: held 0.702s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Created reservations ['b10c4d1c-4224-49a2-b8ab-de452f3d9c96', '42ea7303-b378-4d8d-8e8d-3a45c6fa3916', '2456e244-467d-469d-ae8d-7e98b7c7565c', '75625810-de28-43ea-bd20-e92ea2a70987'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:00 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:04:00 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:00 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.272s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:00 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:00 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Deleted volume successfully. Jul 31 11:04:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cdecf00e-7076-4ab9-b80d-98f36d5da2d1 tempest-ProjectReaderTests-283854032 None] Lock "cinder-6630ea78-cbd0-4187-a4dd-c0aa745038e9-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:02 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3eee1fc8-0205-475d-81b1-8194d8b448ae tempest-VolumesTransfersV355Test-1828066117 None] Transfer volume completed successfully. Jul 31 11:04:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Acquiring lock "cinder-3b5fee85-ca8f-475b-8868-e3b850fd4baa-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Lock "cinder-3b5fee85-ca8f-475b-8868-e3b850fd4baa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Acquiring lock "cinder-quobyte-3b5fee85-ca8f-475b-8868-e3b850fd4baa" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Lock "cinder-quobyte-3b5fee85-ca8f-475b-8868-e3b850fd4baa" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0242f1-c95e-4c2b-888d-5eb1575356e0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:03 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa Jul 31 11:04:03 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:03 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa" returned: 0 in 0.438s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:03 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa Jul 31 11:04:03 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:03 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b5fee85-ca8f-475b-8868-e3b850fd4baa" returned: 0 in 0.263s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Lock "cinder-quobyte-3b5fee85-ca8f-475b-8868-e3b850fd4baa" released by "delete_volume" :: held 0.760s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Created reservations ['9faf0f17-4919-4da1-ae33-ef64b544595d', 'f16aafa4-f6ad-4122-a869-8bc05c1b836d', 'ee771564-3fc0-4047-bebe-3ea9f797be0e', '9b9c67d1-b2cb-4655-ab79-ea91f4f3e3e3'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:03 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:04:03 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:04 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.287s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:04 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Deleted volume successfully. Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-670f10d8-d2ae-43b5-9a3e-4ae1b9a57b8e tempest-VolumesTransfersV355Test-614231336 None] Lock "cinder-3b5fee85-ca8f-475b-8868-e3b850fd4baa-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Flow 'volume_create_manager' (eed2452c-cef0-48cd-af17-b81ffff09628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988d1b3b-b33b-47aa-bbc6-e3033320c7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988d1b3b-b33b-47aa-bbc6-e3033320c7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1121378699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72378de4-43dd-4ad4-8b20-da892a38f60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c81244f0bd4a4ab721dedebc075888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:05Z,use_quota=True,user_id='a8c9532f85f34f73814a76fe5f3bb154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec2733b-66dd-45d3-890c-914d8ae26558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec2733b-66dd-45d3-890c-914d8ae26558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d828c77a-34b2-44d2-a47a-128591cd986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d828c77a-34b2-44d2-a47a-128591cd986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72378de4-43dd-4ad4-8b20-da892a38f60a', 'volume_name': 'volume-72378de4-43dd-4ad4-8b20-da892a38f60a', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1744f1ce-9b64-437e-bda9-8d704866613b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1744f1ce-9b64-437e-bda9-8d704866613b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8233fd-e7fe-4161-8b94-562779ad5213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:04 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Volume 72378de4-43dd-4ad4-8b20-da892a38f60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72378de4-43dd-4ad4-8b20-da892a38f60a', 'volume_size': 1} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1121378699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72378de4-43dd-4ad4-8b20-da892a38f60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c81244f0bd4a4ab721dedebc075888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:05Z,use_quota=True,user_id='a8c9532f85f34f73814a76fe5f3bb154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Creating volume 72378de4-43dd-4ad4-8b20-da892a38f60a {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:04 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:04:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-72378de4-43dd-4ad4-8b20-da892a38f60a 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:04 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-72378de4-43dd-4ad4-8b20-da892a38f60a 1073741824 Jul 31 11:04:04 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:05 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-72378de4-43dd-4ad4-8b20-da892a38f60a 1073741824" returned: 0 in 0.450s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-72378de4-43dd-4ad4-8b20-da892a38f60a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:05 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-72378de4-43dd-4ad4-8b20-da892a38f60a Jul 31 11:04:05 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:05 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-72378de4-43dd-4ad4-8b20-da892a38f60a" returned: 0 in 0.284s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8233fd-e7fe-4161-8b94-562779ad5213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72378de4-43dd-4ad4-8b20-da892a38f60a', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faec918b-5afc-4782-b7b6-7c1f40b851a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Volume volume-72378de4-43dd-4ad4-8b20-da892a38f60a (72378de4-43dd-4ad4-8b20-da892a38f60a): created successfully Jul 31 11:04:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faec918b-5afc-4782-b7b6-7c1f40b851a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Flow 'volume_create_manager' (eed2452c-cef0-48cd-af17-b81ffff09628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:05 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ba761aab-da6c-4eed-b084-e1f9f64c681e tempest-VolumesTransfersV355Test-1408942273 None] Created volume successfully. Jul 31 11:04:07 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Acquiring lock "cinder-72378de4-43dd-4ad4-8b20-da892a38f60a-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:07 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Lock "cinder-72378de4-43dd-4ad4-8b20-da892a38f60a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:07 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Acquiring lock "cinder-quobyte-72378de4-43dd-4ad4-8b20-da892a38f60a" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:07 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Lock "cinder-quobyte-72378de4-43dd-4ad4-8b20-da892a38f60a" acquired by "delete_volume" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:07 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cc2886-8d24-4a23-b717-6ebfe29e0d84]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-72378de4-43dd-4ad4-8b20-da892a38f60a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:07 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-72378de4-43dd-4ad4-8b20-da892a38f60a Jul 31 11:04:07 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:07 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-72378de4-43dd-4ad4-8b20-da892a38f60a" returned: 0 in 0.388s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-72378de4-43dd-4ad4-8b20-da892a38f60a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:07 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-72378de4-43dd-4ad4-8b20-da892a38f60a Jul 31 11:04:07 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:07 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-72378de4-43dd-4ad4-8b20-da892a38f60a" returned: 0 in 0.252s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:07 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Lock "cinder-quobyte-72378de4-43dd-4ad4-8b20-da892a38f60a" released by "delete_volume" :: held 0.677s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:07 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Created reservations ['db0e87a2-0d32-40bc-b3d7-aa0f4d079536', 'abfc08ac-713f-4b4d-8539-91cb9d8b50f7', '42ef02a1-b16c-45db-a6aa-f3d2001afea7', 'a2763376-769d-485c-8b7b-e6c42b48d7ce'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:08 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:04:08 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:08 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.257s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:08 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Deleted volume successfully. Jul 31 11:04:08 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:04:08 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-479a2166-1ceb-4275-ad0c-2b5e7eb00315 tempest-VolumesTransfersV355Test-614231336 None] Lock "cinder-72378de4-43dd-4ad4-8b20-da892a38f60a-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:08 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.316s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:04:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:04:13 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Flow 'volume_create_manager' (bf3c2c5f-5706-4a9c-bb79-c715b25e7f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9399629e-da46-40b1-a75d-85a49f4be368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9399629e-da46-40b1-a75d-85a49f4be368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-534241052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34479be05c1448059626841fa168491f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:14Z,use_quota=True,user_id='75d7a0140998499dbad5305458dc6ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2226e6-0ce3-427c-a68c-ee7536374a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2226e6-0ce3-427c-a68c-ee7536374a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a74234-b0f7-4bce-ab5f-0277455344ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a74234-b0f7-4bce-ab5f-0277455344ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44', 'volume_name': 'volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5accfa0a-cefc-4d0f-bfb7-4b7e6edfdfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5accfa0a-cefc-4d0f-bfb7-4b7e6edfdfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de2cf01-1714-49e0-8d0d-c9bbeaa2ef82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:14 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Volume ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44', 'volume_size': 1} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-534241052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34479be05c1448059626841fa168491f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:14Z,use_quota=True,user_id='75d7a0140998499dbad5305458dc6ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Creating volume ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:14 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:14 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 1073741824 Jul 31 11:04:14 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:14 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 1073741824" returned: 0 in 0.420s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:14 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 Jul 31 11:04:14 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:14 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44" returned: 0 in 0.239s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de2cf01-1714-49e0-8d0d-c9bbeaa2ef82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd264fb-d982-47b3-a433-8c9c53b0da65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=143,cinder:UPDATE=163,cinder:INSERT=36,cinder:DELETE=13 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:04:14 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Volume volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 (ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44): created successfully Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd264fb-d982-47b3-a433-8c9c53b0da65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:14 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Flow 'volume_create_manager' (bf3c2c5f-5706-4a9c-bb79-c715b25e7f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:14 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9b1c7aa8-3c98-48f7-9058-a7ef4a5cda62 tempest-VolumesCloneTest-267128031 None] Created volume successfully. Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Flow 'volume_create_manager' (8bc4f54c-0674-46f8-8e06-a13e85db56a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ba91e0-882d-453a-85b5-cd11e0365bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ba91e0-882d-453a-85b5-cd11e0365bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2059888754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28b240d-94fc-459e-9718-de0649ca2cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34479be05c1448059626841fa168491f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:15Z,use_quota=True,user_id='75d7a0140998499dbad5305458dc6ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e444c3-5582-459c-b198-7825d70e1cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e444c3-5582-459c-b198-7825d70e1cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91397924-d2d7-453c-b985-0de8a52fb09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91397924-d2d7-453c-b985-0de8a52fb09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e28b240d-94fc-459e-9718-de0649ca2cca', 'volume_name': 'volume-e28b240d-94fc-459e-9718-de0649ca2cca', 'volume_size': 2, 'source_volid': 'ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44', 'source_volstatus': 'available'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96034c6a-f8c9-4dc6-a7d8-d06d26e24633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96034c6a-f8c9-4dc6-a7d8-d06d26e24633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a78360d-e545-40a3-b28a-b6d192011a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:15 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Volume e28b240d-94fc-459e-9718-de0649ca2cca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e28b240d-94fc-459e-9718-de0649ca2cca', 'volume_size': 2, 'source_volid': 'ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44', 'source_volstatus': 'available'} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:15 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Cloning volume ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 to volume e28b240d-94fc-459e-9718-de0649ca2cca Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Creating offline snapshot 4858cb25-c9eb-4400-9691-2d4710ad0745 of volume ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e46eff-133d-4940-a694-773285d42ac4]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:15 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 Jul 31 11:04:15 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:16 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44" returned: 0 in 0.401s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:16 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 1G Jul 31 11:04:16 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:16 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 1G" returned: 0 in 0.419s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:16 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 Jul 31 11:04:16 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:16 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745" returned: 0 in 0.277s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:16 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 is being set with open permissions: ugo+rw Jul 31 11:04:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:16 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 Jul 31 11:04:16 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:17 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745" returned: 0 in 0.238s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=155,cinder:SELECT=115,cinder:INSERT=47,cinder:DELETE=15 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:17 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.info Jul 31 11:04:17 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:17 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.info" returned: 0 in 0.247s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:17 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.info is being set with open permissions: ugo+rw Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:17 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.info Jul 31 11:04:17 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:17 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.info" returned: 0 in 0.244s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Acquiring lock "cinder-quobyte-e28b240d-94fc-459e-9718-de0649ca2cca" by "_copy_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Lock "cinder-quobyte-e28b240d-94fc-459e-9718-de0649ca2cca" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] snapshot: 4858cb25-c9eb-4400-9691-2d4710ad0745, volume: e28b240d-94fc-459e-9718-de0649ca2cca, {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c5ca68-1870-4c47-844b-5f8f742cd192]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:17 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 Jul 31 11:04:17 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:17 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745" returned: 0 in 0.344s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Creating direct copy from snapshot {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[17910b78-5302-4654-bf1c-756cd6c70044]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:18 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 Jul 31 11:04:18 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:18 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44" returned: 0 in 0.344s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:18 devstack cinder-volume[89145]: DEBUG cinder.utils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Path /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca not found in is_blk_device check {{(pid=89145) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:04:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:18 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca Jul 31 11:04:18 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:22 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca" returned: 0 in 3.990s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:22 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7518a166-1dfc-472f-a875-44c7ff64b88d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:22 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 Jul 31 11:04:22 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:22 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44" returned: 0 in 0.532s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:22 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44, size 1024.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:04:22 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Converted 1024.00 MB image at 256.52 MB/s Jul 31 11:04:22 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca is being set with open permissions: ugo+rw Jul 31 11:04:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:22 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca Jul 31 11:04:22 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:23 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca" returned: 0 in 0.261s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Lock "cinder-quobyte-e28b240d-94fc-459e-9718-de0649ca2cca" released by "_copy_volume_from_snapshot" :: held 5.552s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Acquiring lock "cinder-quobyte-4858cb25-c9eb-4400-9691-2d4710ad0745" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Lock "cinder-quobyte-4858cb25-c9eb-4400-9691-2d4710ad0745" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Deleting offline snapshot 4858cb25-c9eb-4400-9691-2d4710ad0745 of volume ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:04:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] snapshot_file for this snap is: volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:04:23 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2e668c-92a9-447b-be6a-e5329849ed8a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:23 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 Jul 31 11:04:23 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:23 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745" returned: 0 in 0.436s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:04:23 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ec2172-4140-4620-83ce-ab64666bf529]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:23 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 Jul 31 11:04:23 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:24 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44" returned: 0 in 0.384s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:24 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 Jul 31 11:04:24 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:24 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745" returned: 0 in 0.384s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:24 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745 Jul 31 11:04:24 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:24 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44.4858cb25-c9eb-4400-9691-2d4710ad0745" returned: 0 in 0.248s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Lock "cinder-quobyte-4858cb25-c9eb-4400-9691-2d4710ad0745" released by "_delete_snapshot" :: held 1.543s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.153s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a78360d-e545-40a3-b28a-b6d192011a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e28b240d-94fc-459e-9718-de0649ca2cca', 'volume_size': 2, 'source_volid': 'ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44', 'source_volstatus': 'available'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec29a554-3a0e-474d-bb05-5c9d14e0aae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:24 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Volume volume-e28b240d-94fc-459e-9718-de0649ca2cca (e28b240d-94fc-459e-9718-de0649ca2cca): created successfully Jul 31 11:04:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec29a554-3a0e-474d-bb05-5c9d14e0aae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:24 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Flow 'volume_create_manager' (8bc4f54c-0674-46f8-8e06-a13e85db56a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:24 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f5451e8a-e1a5-42d8-b627-6dd395372cd0 tempest-VolumesCloneTest-267128031 None] Created volume successfully. Jul 31 11:04:25 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Acquiring lock "cinder-e28b240d-94fc-459e-9718-de0649ca2cca-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:25 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Lock "cinder-e28b240d-94fc-459e-9718-de0649ca2cca-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:25 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Acquiring lock "cinder-quobyte-e28b240d-94fc-459e-9718-de0649ca2cca" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:25 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Lock "cinder-quobyte-e28b240d-94fc-459e-9718-de0649ca2cca" acquired by "delete_volume" :: waited 0.013s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:25 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3419d9e-932e-42ad-b82a-ee45664c601f]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:25 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca Jul 31 11:04:25 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:25 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca" returned: 0 in 0.360s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:25 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca Jul 31 11:04:25 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:26 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e28b240d-94fc-459e-9718-de0649ca2cca" returned: 0 in 0.231s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Lock "cinder-quobyte-e28b240d-94fc-459e-9718-de0649ca2cca" released by "delete_volume" :: held 0.632s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Created reservations ['62f04735-09d0-42da-909d-254443e70908', 'e1cfcf35-7279-44db-b63a-54186f5b9cb0', 'cb5e3690-bd83-485f-8fb4-1e29d5695b3c', 'ba62fdc9-220e-4fa5-b244-b3f6b5a3e32d'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:26 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:04:26 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:26 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.225s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:26 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Deleted volume successfully. Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d0956176-18f9-4632-8cd6-e76a7142a381 tempest-VolumesCloneTest-267128031 None] Lock "cinder-e28b240d-94fc-459e-9718-de0649ca2cca-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Acquiring lock "cinder-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Lock "cinder-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Acquiring lock "cinder-quobyte-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Lock "cinder-quobyte-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44" acquired by "delete_volume" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe161d2-fdc5-414c-94ef-20e977e334e6]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:26 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 Jul 31 11:04:26 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:27 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44" returned: 0 in 0.337s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:27 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44 Jul 31 11:04:27 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:27 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44" returned: 0 in 0.254s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Lock "cinder-quobyte-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44" released by "delete_volume" :: held 0.647s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Created reservations ['f2571a1c-822b-4934-a900-a5b5e920c8ab', '311df8f5-ed8d-4f63-b23a-30e889ba062b', 'ba6f1649-1b60-4885-b879-5dbb5eb0514b', 'c814ba87-5a7c-4e59-81e1-1cfc3ae4b697'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:27 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:04:27 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:27 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.258s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:27 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Deleted volume successfully. Jul 31 11:04:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d135e9b7-225f-4418-a6a7-fe76acd2f944 tempest-VolumesCloneTest-267128031 None] Lock "cinder-ce5d9bee-1c36-4a2f-b3fe-dd4e1b0bbb44-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:37 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=20,cinder:SELECT=15,cinder:INSERT=5,cinder:DELETE=2 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:04:37 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=20,cinder:SELECT=11,cinder:INSERT=5,cinder:DELETE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:04:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-d43dad13-7367-4c7c-845a-0304086e7ea6 tempest-TestShelveInstance-444766395 None] Terminate volume connection completed successfully. Jul 31 11:04:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-d43dad13-7367-4c7c-845a-0304086e7ea6 tempest-TestShelveInstance-444766395 None] Deleting attachment 17825d7d-c7bd-4245-bfd7-490db1dfb0a3. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:04:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Acquiring lock "cinder-ec27cda6-40bd-4862-a6a8-d3af171b0113-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Lock "cinder-ec27cda6-40bd-4862-a6a8-d3af171b0113-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Acquiring lock "cinder-quobyte-ec27cda6-40bd-4862-a6a8-d3af171b0113" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Lock "cinder-quobyte-ec27cda6-40bd-4862-a6a8-d3af171b0113" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:42 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[000ebf6c-edf0-4805-a5b9-9c4e8cb9f30f]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:42 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 Jul 31 11:04:42 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:43 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113" returned: 0 in 0.404s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:43 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 Jul 31 11:04:43 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:43 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113" returned: 1 in 0.400s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:43 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113 Jul 31 11:04:43 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:43 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ec27cda6-40bd-4862-a6a8-d3af171b0113" returned: 0 in 0.303s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Lock "cinder-quobyte-ec27cda6-40bd-4862-a6a8-d3af171b0113" released by "delete_volume" :: held 1.204s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG cinder.quota [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Created reservations ['b56703e5-1863-4909-8d75-c78b38ff6113', '756341e9-c5aa-403f-93a7-3e0b7aef0d78', '52a58317-0dbd-4063-a066-e1fed2459948', '7cbad09b-7c2f-4fff-92b0-2f547ccb59b7'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:44 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:04:44 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:44 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.274s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:44 devstack cinder-volume[89145]: DEBUG cinder.manager [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:44 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Deleted volume successfully. Jul 31 11:04:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [req-cf1f28f0-c00c-4852-b3f7-5d49f8b3cf09 req-3b84001d-87e1-474c-9c78-e6345a3f748c tempest-TestShelveInstance-444766395 None] Lock "cinder-ec27cda6-40bd-4862-a6a8-d3af171b0113-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:53 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:INSERT=3 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:04:54 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:05:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:05:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:05:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:05:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:08 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:05:08 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:08 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.250s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:05:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:05:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:05:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Flow 'volume_create_manager' (bde2776e-4d2a-45f7-815a-630621e2122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b334c6-14d1-4262-88f7-2fe7b6923f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b334c6-14d1-4262-88f7-2fe7b6923f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1633636345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcd5873-c8fb-4f43-bd01-41a9ecd5c941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37adc98d941493d8f5fa5cbf954ebbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:05:17Z,use_quota=True,user_id='a8fcd825c07947d89224ddecc67213bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40096d2e-a0c2-44f1-b5c8-9c2aa93969cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40096d2e-a0c2-44f1-b5c8-9c2aa93969cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f58e26-bbdf-442f-af37-dd8d330cb36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f58e26-bbdf-442f-af37-dd8d330cb36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dcd5873-c8fb-4f43-bd01-41a9ecd5c941', 'volume_name': 'volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efab88f4-0e2c-47a8-90bc-13f85693351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efab88f4-0e2c-47a8-90bc-13f85693351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c02868-6bd8-4e5a-b78f-f2452630ef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:17 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Volume 9dcd5873-c8fb-4f43-bd01-41a9ecd5c941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941', 'volume_size': 1} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1633636345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcd5873-c8fb-4f43-bd01-41a9ecd5c941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37adc98d941493d8f5fa5cbf954ebbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:05:17Z,use_quota=True,user_id='a8fcd825c07947d89224ddecc67213bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Creating volume 9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:05:17 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:05:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:17 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 1073741824 Jul 31 11:05:17 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:18 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 1073741824" returned: 0 in 0.540s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:18 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 Jul 31 11:05:18 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:18 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" returned: 0 in 0.330s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:18 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:05:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c02868-6bd8-4e5a-b78f-f2452630ef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301541e8-d1d3-4378-b821-36cf01716f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:18 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Volume volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 (9dcd5873-c8fb-4f43-bd01-41a9ecd5c941): created successfully Jul 31 11:05:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301541e8-d1d3-4378-b821-36cf01716f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Flow 'volume_create_manager' (bde2776e-4d2a-45f7-815a-630621e2122f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:05:18 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-382cefdb-d7d5-4f7b-952d-7ccacc6c9369 tempest-TestStampPattern-14077229 None] Created volume successfully. Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Flow 'volume_create_manager' (6e7f201f-e4a1-4814-9b84-6c0194ea4906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6da3cb7-1b6e-45f4-bf86-7d67f2cc915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6da3cb7-1b6e-45f4-bf86-7d67f2cc915f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-488649413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9108bb1-f548-4548-91e2-bd7be9e365aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685c4acf0ee64309b1582e76b0526897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:05:22Z,use_quota=True,user_id='8f22745112a34b75bfcd36b42ff9214a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a52167-0209-4531-9523-72e3d03ef5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a52167-0209-4531-9523-72e3d03ef5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b44fc04-fb34-48b8-98f5-114220be9c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b44fc04-fb34-48b8-98f5-114220be9c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9108bb1-f548-4548-91e2-bd7be9e365aa', 'volume_name': 'volume-e9108bb1-f548-4548-91e2-bd7be9e365aa', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60e2a81-e349-40b2-b100-54c371872f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60e2a81-e349-40b2-b100-54c371872f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731a255f-08ae-4217-aa47-e1991b60b072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:22 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Volume e9108bb1-f548-4548-91e2-bd7be9e365aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9108bb1-f548-4548-91e2-bd7be9e365aa', 'volume_size': 1} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-488649413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9108bb1-f548-4548-91e2-bd7be9e365aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685c4acf0ee64309b1582e76b0526897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:05:22Z,use_quota=True,user_id='8f22745112a34b75bfcd36b42ff9214a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Creating volume e9108bb1-f548-4548-91e2-bd7be9e365aa {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:05:22 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:22 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa 1073741824 Jul 31 11:05:22 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:22 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa 1073741824" returned: 0 in 0.723s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:23 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa Jul 31 11:05:23 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:23 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa" returned: 0 in 0.428s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:05:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731a255f-08ae-4217-aa47-e1991b60b072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9108bb1-f548-4548-91e2-bd7be9e365aa', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8bcd72-f4a1-4959-8db5-467ffe7e17b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:23 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Volume volume-e9108bb1-f548-4548-91e2-bd7be9e365aa (e9108bb1-f548-4548-91e2-bd7be9e365aa): created successfully Jul 31 11:05:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8bcd72-f4a1-4959-8db5-467ffe7e17b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Flow 'volume_create_manager' (6e7f201f-e4a1-4814-9b84-6c0194ea4906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:05:23 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e16cdd23-8b76-4fc9-b3f2-57f275f3ea00 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Created volume successfully. Jul 31 11:05:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-6048d65e-7973-4868-9804-584578f1091f req-cded5056-63b5-450e-8aff-852419762fd9 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-6048d65e-7973-4868-9804-584578f1091f req-cded5056-63b5-450e-8aff-852419762fd9 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:25 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bf9744-c4cf-4b64-a035-97098e9332d1]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:05:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-6048d65e-7973-4868-9804-584578f1091f req-cded5056-63b5-450e-8aff-852419762fd9 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:25 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa Jul 31 11:05:25 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:25 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-6048d65e-7973-4868-9804-584578f1091f req-cded5056-63b5-450e-8aff-852419762fd9 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa" returned: 0 in 0.382s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-6048d65e-7973-4868-9804-584578f1091f req-cded5056-63b5-450e-8aff-852419762fd9 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.402s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:25 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-6048d65e-7973-4868-9804-584578f1091f req-cded5056-63b5-450e-8aff-852419762fd9 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-e9108bb1-f548-4548-91e2-bd7be9e365aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd78ddd26-1016-406a-9dcf-43ba15ebf3a8', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:05:25 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-6048d65e-7973-4868-9804-584578f1091f req-cded5056-63b5-450e-8aff-852419762fd9 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] attachment_update completed successfully. Jul 31 11:05:28 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-9b22bec0-c24a-4a2b-9d37-f7df9ff4d451 req-d4dd40f2-3c1a-4dae-80dc-95d693f33301 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Terminate volume connection completed successfully. Jul 31 11:05:28 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-9b22bec0-c24a-4a2b-9d37-f7df9ff4d451 req-d4dd40f2-3c1a-4dae-80dc-95d693f33301 tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Deleting attachment d78ddd26-1016-406a-9dcf-43ba15ebf3a8. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:05:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Acquiring lock "cinder-e9108bb1-f548-4548-91e2-bd7be9e365aa-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Lock "cinder-e9108bb1-f548-4548-91e2-bd7be9e365aa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Acquiring lock "cinder-quobyte-e9108bb1-f548-4548-91e2-bd7be9e365aa" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Lock "cinder-quobyte-e9108bb1-f548-4548-91e2-bd7be9e365aa" acquired by "delete_volume" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:29 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f4b31a-07f4-4c94-898c-f6de6a0af075]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:05:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:29 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa Jul 31 11:05:29 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:29 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa" returned: 0 in 0.395s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:29 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa Jul 31 11:05:29 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:30 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9108bb1-f548-4548-91e2-bd7be9e365aa" returned: 0 in 0.297s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Lock "cinder-quobyte-e9108bb1-f548-4548-91e2-bd7be9e365aa" released by "delete_volume" :: held 0.752s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:30 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Created reservations ['9eb730bd-1b7b-4553-a20f-58a2f985841d', '5955613e-772e-4f5b-a900-90377ad64b86', 'f05112c8-db41-4cd7-b6c0-f122fa97a3b7', 'ca9ea116-11de-438c-b4c3-1e5579ff2f0e'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:05:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:05:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:05:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:30 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:05:30 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:30 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.249s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:30 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:05:30 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Deleted volume successfully. Jul 31 11:05:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-336fa929-6ab9-40ee-afb2-6e9e32dc83be tempest-TestServerVolumeAttachScenarioOldVersion-1795333965 None] Lock "cinder-e9108bb1-f548-4548-91e2-bd7be9e365aa-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:40 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=14,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=2 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:05:40 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=18,cinder:UPDATE=18,cinder:INSERT=2,cinder:DELETE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:05:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-bb0d1ac6-e667-492f-95ad-1d9d4dbd1236 req-b878d8a1-bd1e-45c0-b1b4-4371e3415e42 tempest-TestStampPattern-14077229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-bb0d1ac6-e667-492f-95ad-1d9d4dbd1236 req-b878d8a1-bd1e-45c0-b1b4-4371e3415e42 tempest-TestStampPattern-14077229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:50 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c01e4e6-298c-4984-a928-c12413373a9c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:05:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-bb0d1ac6-e667-492f-95ad-1d9d4dbd1236 req-b878d8a1-bd1e-45c0-b1b4-4371e3415e42 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:50 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 Jul 31 11:05:50 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:50 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-bb0d1ac6-e667-492f-95ad-1d9d4dbd1236 req-b878d8a1-bd1e-45c0-b1b4-4371e3415e42 tempest-TestStampPattern-14077229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" returned: 0 in 0.384s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-bb0d1ac6-e667-492f-95ad-1d9d4dbd1236 req-b878d8a1-bd1e-45c0-b1b4-4371e3415e42 tempest-TestStampPattern-14077229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.402s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-bb0d1ac6-e667-492f-95ad-1d9d4dbd1236 req-b878d8a1-bd1e-45c0-b1b4-4371e3415e42 tempest-TestStampPattern-14077229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4381cbb3-d162-427e-8c91-50f8fdbede6b', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:05:50 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-bb0d1ac6-e667-492f-95ad-1d9d4dbd1236 req-b878d8a1-bd1e-45c0-b1b4-4371e3415e42 tempest-TestStampPattern-14077229 None] attachment_update completed successfully. Jul 31 11:05:56 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-592165d0-2bb0-4cbf-8238-1c64313606ec req-527bac9b-1b17-49db-bdcf-8b1b4d1e5249 tempest-TestStampPattern-14077229 None] Terminate volume connection completed successfully. Jul 31 11:05:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-592165d0-2bb0-4cbf-8238-1c64313606ec req-527bac9b-1b17-49db-bdcf-8b1b4d1e5249 tempest-TestStampPattern-14077229 None] Deleting attachment 4381cbb3-d162-427e-8c91-50f8fdbede6b. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:05:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] Creating offline snapshot 88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 of volume 9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:05:58 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[61584230-e6b1-4f83-8f23-35163f009dbc]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:05:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:58 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 Jul 31 11:05:58 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:58 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" returned: 0 in 0.368s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:58 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 1G Jul 31 11:05:58 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:58 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 1G" returned: 0 in 0.451s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:59 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 Jul 31 11:05:59 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:59 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01" returned: 0 in 0.387s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:59 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 is being set with open permissions: ugo+rw Jul 31 11:05:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:59 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 Jul 31 11:05:59 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:59 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01" returned: 0 in 0.274s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:59 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.info Jul 31 11:05:59 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:59 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.info" returned: 0 in 0.285s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:59 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.info is being set with open permissions: ugo+rw Jul 31 11:05:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:59 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.info Jul 31 11:05:59 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:00 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.info" returned: 0 in 0.283s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:00 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2d1680a8-1b81-4b76-9a51-1245c6af1c2d tempest-TestStampPattern-14077229 None] Create snapshot completed successfully Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Flow 'volume_create_manager' (8363001e-d13f-4527-8188-a73a6177ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dda6265-a573-4779-8720-231bbdc84d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dda6265-a573-4779-8720-231bbdc84d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1894034117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca28f00-d06c-4657-9c13-ca7d6fbc3326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528fbeb01a384dada2631d088c769c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:06:05Z,use_quota=True,user_id='7c1e62d765664fefbe85fc078411afde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84e15a6-4b97-4640-ab9d-ef172f4ac705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84e15a6-4b97-4640-ab9d-ef172f4ac705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0d8429-14ac-407d-9024-e4474849bab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0d8429-14ac-407d-9024-e4474849bab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ca28f00-d06c-4657-9c13-ca7d6fbc3326', 'volume_name': 'volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482bbe14-4c90-4d70-8493-211810cb7911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482bbe14-4c90-4d70-8493-211810cb7911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6c05ff-e09d-4263-8dfa-6347bb70be4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:04 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Volume 4ca28f00-d06c-4657-9c13-ca7d6fbc3326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326', 'volume_size': 1} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1894034117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca28f00-d06c-4657-9c13-ca7d6fbc3326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528fbeb01a384dada2631d088c769c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:06:05Z,use_quota=True,user_id='7c1e62d765664fefbe85fc078411afde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Creating volume 4ca28f00-d06c-4657-9c13-ca7d6fbc3326 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:06:04 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:06:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:04 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 1073741824 Jul 31 11:06:04 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:05 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 1073741824" returned: 0 in 0.543s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:05 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 Jul 31 11:06:05 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:05 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326" returned: 0 in 0.279s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:06:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6c05ff-e09d-4263-8dfa-6347bb70be4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e39d49c-0b6e-4cf2-8242-5ec68ad25e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Volume volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 (4ca28f00-d06c-4657-9c13-ca7d6fbc3326): created successfully Jul 31 11:06:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e39d49c-0b6e-4cf2-8242-5ec68ad25e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Flow 'volume_create_manager' (8363001e-d13f-4527-8188-a73a6177ef54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:06:05 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-64a30fcb-e315-4214-87b9-1ff93724d65c tempest-TestImageHashVerification-1935134479 None] Created volume successfully. Jul 31 11:06:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:07 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a902fc73-89d3-4dd6-8140-438634c2df25]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:07 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 Jul 31 11:06:07 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:08 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326" returned: 0 in 0.394s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc61912-9a6d-4875-bfb8-a9cba17f1b55]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:08 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:06:08 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:08 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 Jul 31 11:06:08 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:08 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.266s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:06:08 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326" returned: 0 in 0.394s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 /opt/stack/data/cinder/conversion/4ca28f00-d06c-4657-9c13-ca7d6fbc3326.temp_image.0db9f90a-f9f2-4664-b709-a1755ae9e6d8r3l4czkc.img {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:08 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 /opt/stack/data/cinder/conversion/4ca28f00-d06c-4657-9c13-ca7d6fbc3326.temp_image.0db9f90a-f9f2-4664-b709-a1755ae9e6d8r3l4czkc.img Jul 31 11:06:08 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:10 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:06:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Flow 'volume_create_manager' (90afd772-ffee-4523-950b-6142d1fad230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:06:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c281e8a5-e533-4179-9c1c-9d32e0f7c6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c281e8a5-e533-4179-9c1c-9d32e0f7c6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1909583156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce36e1f1-77e2-4eee-b723-2fae2cecf942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37adc98d941493d8f5fa5cbf954ebbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:06:11Z,use_quota=True,user_id='a8fcd825c07947d89224ddecc67213bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea40bae-747e-4cd1-a2ad-4f6e5c8658c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea40bae-747e-4cd1-a2ad-4f6e5c8658c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1580f3-d9f9-49ac-aab2-5acb95ea284c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1580f3-d9f9-49ac-aab2-5acb95ea284c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ce36e1f1-77e2-4eee-b723-2fae2cecf942', 'volume_name': 'volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942', 'volume_size': 1, 'snapshot_id': '88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc10da0a-0fa6-4fd1-9c9d-04740bae92d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc10da0a-0fa6-4fd1-9c9d-04740bae92d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4097a7-5ef5-43b7-bbba-aa447e9d6cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:10 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Volume ce36e1f1-77e2-4eee-b723-2fae2cecf942: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942', 'volume_size': 1, 'snapshot_id': '88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01'} Jul 31 11:06:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:12 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 /opt/stack/data/cinder/conversion/4ca28f00-d06c-4657-9c13-ca7d6fbc3326.temp_image.0db9f90a-f9f2-4664-b709-a1755ae9e6d8r3l4czkc.img" returned: 0 in 4.414s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:13 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[622214fc-1333-4af2-bff0-98c6934e5472]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:13 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 Jul 31 11:06:13 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:13 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326" returned: 0 in 0.576s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:13 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/conversion/4ca28f00-d06c-4657-9c13-ca7d6fbc3326.temp_image.0db9f90a-f9f2-4664-b709-a1755ae9e6d8r3l4czkc.img {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:06:13 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] Converted 1024.00 MB image at 231.88 MB/s Jul 31 11:06:13 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] 0db9f90a-f9f2-4664-b709-a1755ae9e6d8 was raw, no need to convert to raw {{(pid=89145) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 31 11:06:23 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5,cinder:DELETE=2,cinder:INSERT=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:06:23 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=17,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.824s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] Uploaded volume to glance image-id: 0db9f90a-f9f2-4664-b709-a1755ae9e6d8. {{(pid=89145) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 24.776s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Acquiring lock "cinder-quobyte-88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01-ce36e1f1-77e2-4eee-b723-2fae2cecf942" by "_create_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Lock "cinder-quobyte-88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01-ce36e1f1-77e2-4eee-b723-2fae2cecf942" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Creating volume ce36e1f1-77e2-4eee-b723-2fae2cecf942 from snapshot 88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 {{(pid=89145) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Acquiring lock "cinder-quobyte-ce36e1f1-77e2-4eee-b723-2fae2cecf942" by "_copy_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:06:35 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8c1335fd-1465-47c6-b0f5-1f7aa4e786bd tempest-TestImageHashVerification-1935134479 None] Copy volume to image completed successfully. Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Lock "cinder-quobyte-ce36e1f1-77e2-4eee-b723-2fae2cecf942" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] snapshot: 88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01, volume: ce36e1f1-77e2-4eee-b723-2fae2cecf942, {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a58ba5-371f-48f5-aa82-202eacb01099]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:35 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 Jul 31 11:06:35 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:36 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01" returned: 0 in 0.342s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Creating direct copy from snapshot {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ed6024-b298-4f3a-b415-3216e912643e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:36 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 Jul 31 11:06:36 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:36 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" returned: 0 in 0.399s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG cinder.utils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Path /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 not found in is_blk_device check {{(pid=89145) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:36 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 Jul 31 11:06:36 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Acquiring lock "cinder-4ca28f00-d06c-4657-9c13-ca7d6fbc3326-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Lock "cinder-4ca28f00-d06c-4657-9c13-ca7d6fbc3326-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Acquiring lock "cinder-quobyte-4ca28f00-d06c-4657-9c13-ca7d6fbc3326" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Lock "cinder-quobyte-4ca28f00-d06c-4657-9c13-ca7d6fbc3326" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[970e1cc9-1d16-43a1-af56-ba630c04be0a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:37 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 Jul 31 11:06:37 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:37 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326" returned: 0 in 0.537s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:37 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326 Jul 31 11:06:37 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:38 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ca28f00-d06c-4657-9c13-ca7d6fbc3326" returned: 0 in 0.491s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Lock "cinder-quobyte-4ca28f00-d06c-4657-9c13-ca7d6fbc3326" released by "delete_volume" :: held 1.109s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:06:38 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Created reservations ['e1abb57c-03f8-4c7c-974c-8938f7844c4b', '34bd865b-f955-46d6-94fa-dec12c12a3be', '0ff0426e-8b2b-4514-841d-dc3c316ff8cf', '476dcfcc-3c58-40b9-a4d3-025f22abcb63'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:06:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:06:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:06:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:38 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:06:38 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:38 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.467s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:38 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:06:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Deleted volume successfully. Jul 31 11:06:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-22378a61-fccf-4ea9-b49a-ace29ffc021f tempest-TestImageHashVerification-1935134479 None] Lock "cinder-4ca28f00-d06c-4657-9c13-ca7d6fbc3326-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:06:41 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942" returned: 0 in 4.609s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[582c5eff-f05d-416a-a585-7c45accc6cfa]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:41 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 Jul 31 11:06:41 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:41 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" returned: 0 in 0.578s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:06:41 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Converted 1024.00 MB image at 222.13 MB/s Jul 31 11:06:41 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 is being set with open permissions: ugo+rw Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:41 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 Jul 31 11:06:41 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:41 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942" returned: 0 in 0.241s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Lock "cinder-quobyte-ce36e1f1-77e2-4eee-b723-2fae2cecf942" released by "_copy_volume_from_snapshot" :: held 6.265s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Lock "cinder-quobyte-88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01-ce36e1f1-77e2-4eee-b723-2fae2cecf942" released by "_create_volume_from_snapshot" :: held 6.300s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.323s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4097a7-5ef5-43b7-bbba-aa447e9d6cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942', 'volume_size': 1, 'snapshot_id': '88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb015aa-8204-411a-8a3d-2be312ae1521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:41 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Volume volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 (ce36e1f1-77e2-4eee-b723-2fae2cecf942): created successfully Jul 31 11:06:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb015aa-8204-411a-8a3d-2be312ae1521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Flow 'volume_create_manager' (90afd772-ffee-4523-950b-6142d1fad230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:06:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-444a3ca0-c546-4764-87d9-bbc892653774 tempest-TestStampPattern-14077229 None] Created volume successfully. Jul 31 11:06:52 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=13,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:06:52 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:06:52 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:06:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Flow 'volume_create_manager' (d2e069e4-68d1-4867-a1a2-5d295a8b6d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:06:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aae56b8-df3d-4c8f-90af-1870ad84d715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aae56b8-df3d-4c8f-90af-1870ad84d715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80dcc08c-d5c6-482d-a1a5-9600a5550aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5729632b54ef4503b50e7594dc899189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:06:53Z,use_quota=True,user_id='f7965dbb33774d9da0ba22c31867a176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8873aa6-fcc4-4104-9bdd-b90b044d9947),volume_type_id=b8873aa6-fcc4-4104-9bdd-b90b044d9947)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3ae8b7-0e41-40d5-9a0f-683ca6dd9723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3ae8b7-0e41-40d5-9a0f-683ca6dd9723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6bdb6d-3c91-43d3-b52c-f69356b5c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG cinder.image.glance [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Creating Keystone auth plugin from conf {{(pid=89145) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6bdb6d-3c91-43d3-b52c-f69356b5c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '80dcc08c-d5c6-482d-a1a5-9600a5550aae', 'volume_name': 'volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae', 'volume_size': 1, 'image_id': '7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49b76bb5784d979eee4e023521700e51', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5729632b54ef4503b50e7594dc899189', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e21ac3c17ed5239a178fd6374cd1f8a544fe80c69cef9929205816a2da1cc981ff7e41dc6838e4b99f5b76f35c24f8b888dfd45b51bcf32b9d9a49eb8c2516f', 'id': '7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'created_at': datetime.datetime(2026, 7, 31, 9, 6, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bf6fe4c-5978-4dfe-9492-33e8a002ec9a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfa4986-5722-4ad8-bbeb-bdd8d54d36bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfa4986-5722-4ad8-bbeb-bdd8d54d36bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c95f1a-7fc0-45e8-a20c-f87e65eed17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:53 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Volume 80dcc08c-d5c6-482d-a1a5-9600a5550aae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae', 'volume_size': 1, 'image_id': '7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49b76bb5784d979eee4e023521700e51', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5729632b54ef4503b50e7594dc899189', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e21ac3c17ed5239a178fd6374cd1f8a544fe80c69cef9929205816a2da1cc981ff7e41dc6838e4b99f5b76f35c24f8b888dfd45b51bcf32b9d9a49eb8c2516f', 'id': '7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'created_at': datetime.datetime(2026, 7, 31, 9, 6, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bf6fe4c-5978-4dfe-9492-33e8a002ec9a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Trying to clone 80dcc08c-d5c6-482d-a1a5-9600a5550aae from image 7bf6fe4c-5978-4dfe-9492-33e8a002ec9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'metadata': {}}]). {{(pid=89145) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:06:53 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Image download 0.00 MB at 0.00 MB/s Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[369aec3d-5089-4f89-bdbd-41485f1fa6c5]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:53 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD Jul 31 11:06:53 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:53 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:53 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD Jul 31 11:06:53 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:53 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD" returned: 1 in 0.308s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:06:53 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Temporary image 7bf6fe4c-5978-4dfe-9492-33e8a002ec9a is fetched for user f7965dbb33774d9da0ba22c31867a176. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a278272f-455c-44f2-9a2c-1b8b0ac1ca56]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:54 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD Jul 31 11:06:54 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:54 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD" returned: 0 in 0.309s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:54 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD Jul 31 11:06:54 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:54 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD" returned: 1 in 0.311s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80dcc08c-d5c6-482d-a1a5-9600a5550aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5729632b54ef4503b50e7594dc899189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:06:53Z,use_quota=True,user_id='f7965dbb33774d9da0ba22c31867a176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8873aa6-fcc4-4104-9bdd-b90b044d9947),volume_type_id=b8873aa6-fcc4-4104-9bdd-b90b044d9947)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Creating volume 80dcc08c-d5c6-482d-a1a5-9600a5550aae {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:06:54 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:06:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:54 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae 1073741824 Jul 31 11:06:54 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:55 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae 1073741824" returned: 0 in 0.407s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:55 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae Jul 31 11:06:55 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:55 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae" returned: 0 in 0.248s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:06:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:55 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Attempting download of 7bf6fe4c-5978-4dfe-9492-33e8a002ec9a ((None, [{'url': 'file:///opt/stack/data/glance/images/7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'metadata': {}}])) to volume 80dcc08c-d5c6-482d-a1a5-9600a5550aae. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:06:55 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[347cae9e-f84f-44e5-8fba-5669b7b515fa]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a_11enrvx4 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:55 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a_11enrvx4 Jul 31 11:06:55 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:55 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a_11enrvx4" returned: 0 in 0.314s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a_11enrvx4 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:55 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a_11enrvx4 Jul 31 11:06:55 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:56 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a_11enrvx4" returned: 1 in 0.314s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a_11enrvx4' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:06:56 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[44420b5d-3edf-40ca-b9c6-0d6bfc5741ff]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:56 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD Jul 31 11:06:56 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:56 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD" returned: 0 in 0.307s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:56 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD Jul 31 11:06:56 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:56 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD" returned: 1 in 0.319s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:06:56 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] 7bf6fe4c-5978-4dfe-9492-33e8a002ec9a was raw, converting to raw {{(pid=89145) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:06:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:56 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae Jul 31 11:06:56 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:57 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae" returned: 0 in 0.319s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7bf6fe4c-5978-4dfe-9492-33e8a002ec9a__x1ndstedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:06:57 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:57 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae 1G Jul 31 11:06:57 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:57 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae 1G" returned: 0 in 0.275s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01ff6a2-c25c-49c7-8fc6-5691f5825d7e]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:57 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae Jul 31 11:06:57 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:57 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae" returned: 0 in 0.330s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:57 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae Jul 31 11:06:57 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:57 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae" returned: 1 in 0.337s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Downloaded image 7bf6fe4c-5978-4dfe-9492-33e8a002ec9a ((None, [{'url': 'file:///opt/stack/data/glance/images/7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'metadata': {}}])) to volume 80dcc08c-d5c6-482d-a1a5-9600a5550aae successfully. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Temporary image 7bf6fe4c-5978-4dfe-9492-33e8a002ec9a for user f7965dbb33774d9da0ba22c31867a176 is deleted. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:06:57 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Marking volume 80dcc08c-d5c6-482d-a1a5-9600a5550aae as bootable. {{(pid=89145) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Copying metadata from image 7bf6fe4c-5978-4dfe-9492-33e8a002ec9a to 80dcc08c-d5c6-482d-a1a5-9600a5550aae. {{(pid=89145) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Creating volume glance metadata for volume 80dcc08c-d5c6-482d-a1a5-9600a5550aae backed by image 7bf6fe4c-5978-4dfe-9492-33e8a002ec9a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '49b76bb5784d979eee4e023521700e51', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89145) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c95f1a-7fc0-45e8-a20c-f87e65eed17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae', 'volume_size': 1, 'image_id': '7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49b76bb5784d979eee4e023521700e51', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5729632b54ef4503b50e7594dc899189', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e21ac3c17ed5239a178fd6374cd1f8a544fe80c69cef9929205816a2da1cc981ff7e41dc6838e4b99f5b76f35c24f8b888dfd45b51bcf32b9d9a49eb8c2516f', 'id': '7bf6fe4c-5978-4dfe-9492-33e8a002ec9a', 'created_at': datetime.datetime(2026, 7, 31, 9, 6, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bf6fe4c-5978-4dfe-9492-33e8a002ec9a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3746b1-8f26-4fb1-8b18-a04575080c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:58 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Volume volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae (80dcc08c-d5c6-482d-a1a5-9600a5550aae): created successfully Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3746b1-8f26-4fb1-8b18-a04575080c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Flow 'volume_create_manager' (d2e069e4-68d1-4867-a1a2-5d295a8b6d08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:06:58 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a437d924-99b0-484f-9c72-863c0d560cb0 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Created volume successfully. Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Acquiring lock "cinder-80dcc08c-d5c6-482d-a1a5-9600a5550aae-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Lock "cinder-80dcc08c-d5c6-482d-a1a5-9600a5550aae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Acquiring lock "cinder-quobyte-80dcc08c-d5c6-482d-a1a5-9600a5550aae" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Lock "cinder-quobyte-80dcc08c-d5c6-482d-a1a5-9600a5550aae" acquired by "delete_volume" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda8f154-1833-43f4-a95a-b6c062630a6f]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:58 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae Jul 31 11:06:58 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:58 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae" returned: 0 in 0.340s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:58 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae Jul 31 11:06:58 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:58 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae" returned: 1 in 0.329s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:06:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:59 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae Jul 31 11:06:59 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:59 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-80dcc08c-d5c6-482d-a1a5-9600a5550aae" returned: 0 in 0.232s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Lock "cinder-quobyte-80dcc08c-d5c6-482d-a1a5-9600a5550aae" released by "delete_volume" :: held 0.958s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:06:59 devstack cinder-volume[89145]: WARNING cinder.quota [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 31 11:06:59 devstack cinder-volume[89145]: WARNING cinder.quota [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 31 11:06:59 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Created reservations ['1ac8337f-4a93-433b-9771-7fb0e3e97bba', '6f4b35e2-4e17-4826-a074-04c7aa7bd0f3', '9a305289-4652-4a71-9f25-5c823a9ddc56', 'd62aabf5-7202-4631-8928-f5ae891531fc'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:06:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:06:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:06:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:59 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:06:59 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:59 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:59 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:06:59 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Deleted volume successfully. Jul 31 11:06:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fdc56e76-f04e-4107-af7a-c4161215db53 tempest-VolumeAndVolumeTypeFromImageTest-1988397643 None] Lock "cinder-80dcc08c-d5c6-482d-a1a5-9600a5550aae-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-86ba8671-77ca-4e72-ad37-9df7705f69b6 req-7c855806-046f-4a4b-ac98-16b42d48f0cf tempest-TestStampPattern-14077229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-86ba8671-77ca-4e72-ad37-9df7705f69b6 req-7c855806-046f-4a4b-ac98-16b42d48f0cf tempest-TestStampPattern-14077229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:02 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a45f756-4fa1-4c5f-aa5f-f865216351d8]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-86ba8671-77ca-4e72-ad37-9df7705f69b6 req-7c855806-046f-4a4b-ac98-16b42d48f0cf tempest-TestStampPattern-14077229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:02 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 Jul 31 11:07:02 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:02 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [req-86ba8671-77ca-4e72-ad37-9df7705f69b6 req-7c855806-046f-4a4b-ac98-16b42d48f0cf tempest-TestStampPattern-14077229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942" returned: 0 in 0.409s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [req-86ba8671-77ca-4e72-ad37-9df7705f69b6 req-7c855806-046f-4a4b-ac98-16b42d48f0cf tempest-TestStampPattern-14077229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.428s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-86ba8671-77ca-4e72-ad37-9df7705f69b6 req-7c855806-046f-4a4b-ac98-16b42d48f0cf tempest-TestStampPattern-14077229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445', 'name': 'volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad6de58a-5347-4293-8636-d112154427e5', 'enforce_multipath': True} {{(pid=89145) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:07:02 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-86ba8671-77ca-4e72-ad37-9df7705f69b6 req-7c855806-046f-4a4b-ac98-16b42d48f0cf tempest-TestStampPattern-14077229 None] attachment_update completed successfully. Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Flow 'volume_create_manager' (86628f11-7681-4fca-9c53-4dbd9c3e5e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7469f46e-7019-4a59-bd1c-212214cafe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7469f46e-7019-4a59-bd1c-212214cafe2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-661362554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee7dd19-2d62-45b1-b028-eeca998c5c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f771d207758404d820bb7b6ef1ddf97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:05Z,use_quota=True,user_id='c68f59df662544848f21c222989392cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f1819a-0341-4027-b7a5-03c35498b6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f1819a-0341-4027-b7a5-03c35498b6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f3ea68-3098-43c5-af24-b0e8b635a7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f3ea68-3098-43c5-af24-b0e8b635a7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ee7dd19-2d62-45b1-b028-eeca998c5c5d', 'volume_name': 'volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7ea11e-2a61-4efb-b92e-d621df58a217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7ea11e-2a61-4efb-b92e-d621df58a217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c1cf03-7d5a-468b-8372-1cf29011594b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Volume 4ee7dd19-2d62-45b1-b028-eeca998c5c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d', 'volume_size': 1} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-661362554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee7dd19-2d62-45b1-b028-eeca998c5c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f771d207758404d820bb7b6ef1ddf97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:05Z,use_quota=True,user_id='c68f59df662544848f21c222989392cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Creating volume 4ee7dd19-2d62-45b1-b028-eeca998c5c5d {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:05 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:05 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d 1073741824 Jul 31 11:07:05 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Flow 'volume_create_manager' (857d868e-9ab4-4b5b-941a-e5ff48b4ceff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947e15db-ffe4-40de-b621-17e676df47d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947e15db-ffe4-40de-b621-17e676df47d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-894095145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85015b93-212b-4d0b-8f95-b95ea56a0cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f771d207758404d820bb7b6ef1ddf97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:05Z,use_quota=True,user_id='c68f59df662544848f21c222989392cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32901fe5-956a-479b-9ea3-b31068e96e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32901fe5-956a-479b-9ea3-b31068e96e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5c8669-3aca-4280-a1ad-902fe5ec4ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5c8669-3aca-4280-a1ad-902fe5ec4ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85015b93-212b-4d0b-8f95-b95ea56a0cf5', 'volume_name': 'volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbdd8a2-1040-4e02-a365-73b499caa48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbdd8a2-1040-4e02-a365-73b499caa48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfd7ba5-378b-4323-9676-23a526ab587e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Volume 85015b93-212b-4d0b-8f95-b95ea56a0cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5', 'volume_size': 1} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:05 devstack cinder-volume[89145]: INFO cinder.volume.manager [req-8b53563c-a061-4733-a918-c9fcd88553b5 req-50359f2b-3bdf-4c2d-ab9a-1cfbc2ab62e9 tempest-TestStampPattern-14077229 None] Terminate volume connection completed successfully. Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [req-8b53563c-a061-4733-a918-c9fcd88553b5 req-50359f2b-3bdf-4c2d-ab9a-1cfbc2ab62e9 tempest-TestStampPattern-14077229 None] Deleting attachment ad6de58a-5347-4293-8636-d112154427e5. {{(pid=89145) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:07:05 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d 1073741824" returned: 0 in 0.631s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Flow 'volume_create_manager' (8809dfd0-0724-4a84-b101-78e29025078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81424c7-aaf3-4cb7-a0ed-c3a57da21c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81424c7-aaf3-4cb7-a0ed-c3a57da21c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1574361095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbaad987-d579-4734-a822-e4fe1c85e766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f771d207758404d820bb7b6ef1ddf97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:06Z,use_quota=True,user_id='c68f59df662544848f21c222989392cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bf5edd-0e92-4cae-9657-fdc864df3941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d Jul 31 11:07:06 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bf5edd-0e92-4cae-9657-fdc864df3941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b648933-d711-47ee-9995-f289a8b66ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b648933-d711-47ee-9995-f289a8b66ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbaad987-d579-4734-a822-e4fe1c85e766', 'volume_name': 'volume-cbaad987-d579-4734-a822-e4fe1c85e766', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fefc69-2e46-4502-b9eb-bfb917ead232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fefc69-2e46-4502-b9eb-bfb917ead232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae5769e-2237-49bf-a2bc-63f6e8684321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Volume cbaad987-d579-4734-a822-e4fe1c85e766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbaad987-d579-4734-a822-e4fe1c85e766', 'volume_size': 1} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:06 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d" returned: 0 in 0.480s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.863s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-894095145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85015b93-212b-4d0b-8f95-b95ea56a0cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f771d207758404d820bb7b6ef1ddf97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:05Z,use_quota=True,user_id='c68f59df662544848f21c222989392cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Creating volume 85015b93-212b-4d0b-8f95-b95ea56a0cf5 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:06 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:06 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5 1073741824 Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c1cf03-7d5a-468b-8372-1cf29011594b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86607d25-41ae-408c-bed9-ec7813e23bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Flow 'volume_create_manager' (f8411aaf-a0b8-4f32-969f-c2ff81b22ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca1fcfc-f712-4fcd-af6b-83a9879fa4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca1fcfc-f712-4fcd-af6b-83a9879fa4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123908940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadb3f48-08e7-4ac5-bd27-9972167b610c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f771d207758404d820bb7b6ef1ddf97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:06Z,use_quota=True,user_id='c68f59df662544848f21c222989392cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b505a8f9-864e-423e-bf11-4a9d7b92ac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b505a8f9-864e-423e-bf11-4a9d7b92ac7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4052c00a-f130-422b-a46b-50f8d638eb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4052c00a-f130-422b-a46b-50f8d638eb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fadb3f48-08e7-4ac5-bd27-9972167b610c', 'volume_name': 'volume-fadb3f48-08e7-4ac5-bd27-9972167b610c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9c3804-eb76-4090-98e8-a899fe38c0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9c3804-eb76-4090-98e8-a899fe38c0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a3120e-2573-4051-a304-104f8c6f0e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Volume fadb3f48-08e7-4ac5-bd27-9972167b610c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fadb3f48-08e7-4ac5-bd27-9972167b610c', 'volume_size': 1} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:06 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Volume volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d (4ee7dd19-2d62-45b1-b028-eeca998c5c5d): created successfully Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86607d25-41ae-408c-bed9-ec7813e23bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Flow 'volume_create_manager' (86628f11-7681-4fca-9c53-4dbd9c3e5e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:06 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-0494e0c5-7afd-4f08-b60f-6353935e674e tempest-CreateVolumesFromImageTest-178634085 None] Created volume successfully. Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Flow 'volume_create_manager' (e2094162-13f5-421e-bbb5-5419fe9b4619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3cc531-a286-411a-99ce-6decfb198786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3cc531-a286-411a-99ce-6decfb198786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-449777911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f96aee-5b7d-4924-a1b8-27c2bbb57798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f771d207758404d820bb7b6ef1ddf97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:07Z,use_quota=True,user_id='c68f59df662544848f21c222989392cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79912849-6d16-4ae7-8ccd-d4238d08c824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79912849-6d16-4ae7-8ccd-d4238d08c824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e50b7ee-01a5-4040-af7c-ed5f6774497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e50b7ee-01a5-4040-af7c-ed5f6774497b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f96aee-5b7d-4924-a1b8-27c2bbb57798', 'volume_name': 'volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b23c5c-2990-4c56-a606-7f7914f3ebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b23c5c-2990-4c56-a606-7f7914f3ebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfad20bc-1deb-4cdd-ab39-7f3fba4418ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:06 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Volume c5f96aee-5b7d-4924-a1b8-27c2bbb57798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798', 'volume_size': 1} Jul 31 11:07:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:07 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5 1073741824" returned: 0 in 0.716s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:07 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5 Jul 31 11:07:07 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:07 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5" returned: 0 in 0.362s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1574361095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbaad987-d579-4734-a822-e4fe1c85e766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f771d207758404d820bb7b6ef1ddf97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:06Z,use_quota=True,user_id='c68f59df662544848f21c222989392cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Creating volume cbaad987-d579-4734-a822-e4fe1c85e766 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:07 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cbaad987-d579-4734-a822-e4fe1c85e766 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfd7ba5-378b-4323-9676-23a526ab587e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:07 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cbaad987-d579-4734-a822-e4fe1c85e766 1073741824 Jul 31 11:07:07 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc82ade-3964-4cbb-9598-0c33226d09ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:07 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Volume volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5 (85015b93-212b-4d0b-8f95-b95ea56a0cf5): created successfully Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc82ade-3964-4cbb-9598-0c33226d09ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:07 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Flow 'volume_create_manager' (857d868e-9ab4-4b5b-941a-e5ff48b4ceff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:07 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e8ab9712-2f7f-4eac-82a3-56e8b80ba357 tempest-CreateVolumesFromImageTest-178634085 None] Created volume successfully. Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:08 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:08 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:08 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cbaad987-d579-4734-a822-e4fe1c85e766 1073741824" returned: 0 in 0.701s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cbaad987-d579-4734-a822-e4fe1c85e766 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:08 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cbaad987-d579-4734-a822-e4fe1c85e766 Jul 31 11:07:08 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:08 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.328s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:07:08 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cbaad987-d579-4734-a822-e4fe1c85e766" returned: 0 in 0.315s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.076s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123908940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadb3f48-08e7-4ac5-bd27-9972167b610c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f771d207758404d820bb7b6ef1ddf97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:06Z,use_quota=True,user_id='c68f59df662544848f21c222989392cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Creating volume fadb3f48-08e7-4ac5-bd27-9972167b610c {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:08 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fadb3f48-08e7-4ac5-bd27-9972167b610c 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae5769e-2237-49bf-a2bc-63f6e8684321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbaad987-d579-4734-a822-e4fe1c85e766', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:08 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fadb3f48-08e7-4ac5-bd27-9972167b610c 1073741824 Jul 31 11:07:08 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfd0104-c953-4276-b083-34133c070a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:08 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Volume volume-cbaad987-d579-4734-a822-e4fe1c85e766 (cbaad987-d579-4734-a822-e4fe1c85e766): created successfully Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfd0104-c953-4276-b083-34133c070a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Flow 'volume_create_manager' (8809dfd0-0724-4a84-b101-78e29025078f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:08 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7304eb8f-4802-436a-9c76-44d1b6aa57cf tempest-CreateVolumesFromImageTest-178634085 None] Created volume successfully. Jul 31 11:07:09 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fadb3f48-08e7-4ac5-bd27-9972167b610c 1073741824" returned: 0 in 0.610s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fadb3f48-08e7-4ac5-bd27-9972167b610c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:09 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fadb3f48-08e7-4ac5-bd27-9972167b610c Jul 31 11:07:09 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:09 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fadb3f48-08e7-4ac5-bd27-9972167b610c" returned: 0 in 0.258s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.749s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-449777911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f96aee-5b7d-4924-a1b8-27c2bbb57798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f771d207758404d820bb7b6ef1ddf97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:07Z,use_quota=True,user_id='c68f59df662544848f21c222989392cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Creating volume c5f96aee-5b7d-4924-a1b8-27c2bbb57798 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:09 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:09 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798 1073741824 Jul 31 11:07:09 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a3120e-2573-4051-a304-104f8c6f0e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fadb3f48-08e7-4ac5-bd27-9972167b610c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e2573e-e15a-4a1b-829e-02b741d33b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:09 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Volume volume-fadb3f48-08e7-4ac5-bd27-9972167b610c (fadb3f48-08e7-4ac5-bd27-9972167b610c): created successfully Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e2573e-e15a-4a1b-829e-02b741d33b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:09 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Flow 'volume_create_manager' (f8411aaf-a0b8-4f32-969f-c2ff81b22ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:09 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1e77a003-afeb-4761-a7c3-5d2f64e4ae3a tempest-CreateVolumesFromImageTest-178634085 None] Created volume successfully. Jul 31 11:07:10 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798 1073741824" returned: 0 in 0.440s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:10 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798 Jul 31 11:07:10 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Acquiring lock "cinder-ce36e1f1-77e2-4eee-b723-2fae2cecf942-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Lock "cinder-ce36e1f1-77e2-4eee-b723-2fae2cecf942-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Acquiring lock "cinder-quobyte-ce36e1f1-77e2-4eee-b723-2fae2cecf942" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Lock "cinder-quobyte-ce36e1f1-77e2-4eee-b723-2fae2cecf942" acquired by "delete_volume" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e407bfc-6efc-4346-bbca-a3004b6b371e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:10 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798" returned: 0 in 0.269s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfad20bc-1deb-4cdd-ab39-7f3fba4418ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7216cff1-0915-4d74-be0e-248d1d5f5119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:10 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Volume volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798 (c5f96aee-5b7d-4924-a1b8-27c2bbb57798): created successfully Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7216cff1-0915-4d74-be0e-248d1d5f5119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Flow 'volume_create_manager' (e2094162-13f5-421e-bbb5-5419fe9b4619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-87f63a43-8376-4555-ad9d-9580aea1edc9 tempest-CreateVolumesFromImageTest-178634085 None] Created volume successfully. Jul 31 11:07:10 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 Jul 31 11:07:10 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:10 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942" returned: 0 in 0.356s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:10 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942 Jul 31 11:07:10 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:10 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-ce36e1f1-77e2-4eee-b723-2fae2cecf942" returned: 0 in 0.238s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Lock "cinder-quobyte-ce36e1f1-77e2-4eee-b723-2fae2cecf942" released by "delete_volume" :: held 0.637s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Created reservations ['25c3be0f-769d-4f6d-8990-b81f267bdbc2', 'f1ed2936-91ea-4739-addd-74af5d141bb2', 'b1cd289d-d045-43b3-8912-bcecfc49b954', 'e6823720-6f26-4df2-820a-531226bcd465'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:11 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:11 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:11 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.266s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:11 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Deleted volume successfully. Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6d091e0c-9a78-4366-9a04-4810d631c071 tempest-TestStampPattern-14077229 None] Lock "cinder-ce36e1f1-77e2-4eee-b723-2fae2cecf942-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "cinder-c5f96aee-5b7d-4924-a1b8-27c2bbb57798-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-c5f96aee-5b7d-4924-a1b8-27c2bbb57798-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "cinder-quobyte-c5f96aee-5b7d-4924-a1b8-27c2bbb57798" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-quobyte-c5f96aee-5b7d-4924-a1b8-27c2bbb57798" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc85884-227a-4265-9319-873937d93ee3]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:11 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798 Jul 31 11:07:11 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Acquiring lock "cinder-88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Lock "cinder-88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Acquiring lock "cinder-quobyte-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Lock "cinder-quobyte-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Acquiring lock "cinder-quobyte-88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Lock "cinder-quobyte-88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Deleting offline snapshot 88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 of volume 9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] snapshot_file for this snap is: volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b13bc3-e00b-4d4f-86ff-b65fe6d1ce7b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:11 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 Jul 31 11:07:11 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:12 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798" returned: 0 in 0.392s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:12 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798 Jul 31 11:07:12 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:12 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01" returned: 0 in 0.398s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77056ff-64ed-4ccc-99bc-c6e21b9acf34]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:12 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-c5f96aee-5b7d-4924-a1b8-27c2bbb57798" returned: 0 in 0.292s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-quobyte-c5f96aee-5b7d-4924-a1b8-27c2bbb57798" released by "delete_volume" :: held 0.732s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Created reservations ['eedd4829-5f6c-4866-830a-ae6aeb2941fb', '15e6f90f-5bb2-4c06-a13d-e06ac0ff327e', 'b26ea02c-cda4-4c63-aa6a-cb57f12fb710', '32af9063-ae39-4e7f-afd2-62d31b3de69d'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:12 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 Jul 31 11:07:12 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:12 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:12 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:12 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" returned: 0 in 0.380s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:12 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 Jul 31 11:07:12 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "cinder-fadb3f48-08e7-4ac5-bd27-9972167b610c-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:12 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.279s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-fadb3f48-08e7-4ac5-bd27-9972167b610c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:12 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Deleted volume successfully. Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2ee3808c-976d-4c94-8217-d96426ec3968 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-c5f96aee-5b7d-4924-a1b8-27c2bbb57798-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "cinder-quobyte-fadb3f48-08e7-4ac5-bd27-9972167b610c" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-quobyte-fadb3f48-08e7-4ac5-bd27-9972167b610c" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e806f9-71bb-44d3-b0ec-cf5d2384f8b0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fadb3f48-08e7-4ac5-bd27-9972167b610c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:12 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fadb3f48-08e7-4ac5-bd27-9972167b610c Jul 31 11:07:12 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:13 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01" returned: 0 in 0.367s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:13 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01 Jul 31 11:07:13 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:13 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fadb3f48-08e7-4ac5-bd27-9972167b610c" returned: 0 in 0.391s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fadb3f48-08e7-4ac5-bd27-9972167b610c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:13 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fadb3f48-08e7-4ac5-bd27-9972167b610c Jul 31 11:07:13 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:13 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941.88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01" returned: 0 in 0.267s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Lock "cinder-quobyte-88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01" released by "_delete_snapshot" :: held 1.524s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Lock "cinder-quobyte-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" released by "delete_snapshot" :: held 1.556s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Created reservations ['c6501bb7-f6db-4ed5-8326-fa7f639e02ae', 'f6808d2a-0249-49ca-8ad0-5238b1f30b04', '46bfeda6-923d-4479-8b94-f9b51902ba50', '729488d4-b958-4b65-8945-8774aa7eeb21'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:13 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Delete snapshot completed successfully. Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58c6c419-3589-4f0a-954a-2d1d1c2a09e4 tempest-TestStampPattern-14077229 None] Lock "cinder-88b4f2ea-2ae8-4d3b-949b-e56b2c4e8c01-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:13 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fadb3f48-08e7-4ac5-bd27-9972167b610c" returned: 0 in 0.266s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-quobyte-fadb3f48-08e7-4ac5-bd27-9972167b610c" released by "delete_volume" :: held 0.713s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Created reservations ['f9563bfb-4f1f-4b3e-b9ab-b89edbd3e4de', '013e272d-6e54-4acb-b465-164db759a87c', '11813cce-2fb1-4470-bb4c-58ef9c022a7d', '9d7608bd-c94c-4aa1-8558-9970165cf9f1'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:13 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:13 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "cinder-cbaad987-d579-4734-a822-e4fe1c85e766-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-cbaad987-d579-4734-a822-e4fe1c85e766-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:13 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.266s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:13 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Deleted volume successfully. Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "cinder-quobyte-cbaad987-d579-4734-a822-e4fe1c85e766" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-62859019-0e72-4c62-ae0a-ec3b5c253e75 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-fadb3f48-08e7-4ac5-bd27-9972167b610c-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-quobyte-cbaad987-d579-4734-a822-e4fe1c85e766" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[411cb405-dfc8-4ee7-8932-e5a32e4859d7]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cbaad987-d579-4734-a822-e4fe1c85e766 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:14 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cbaad987-d579-4734-a822-e4fe1c85e766 Jul 31 11:07:14 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:14 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cbaad987-d579-4734-a822-e4fe1c85e766" returned: 0 in 0.372s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cbaad987-d579-4734-a822-e4fe1c85e766 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:14 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cbaad987-d579-4734-a822-e4fe1c85e766 Jul 31 11:07:14 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:14 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cbaad987-d579-4734-a822-e4fe1c85e766" returned: 0 in 0.309s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-quobyte-cbaad987-d579-4734-a822-e4fe1c85e766" released by "delete_volume" :: held 0.736s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:14 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Created reservations ['878150de-015a-46e4-8014-7b4ac1e6a47e', '2751dced-2a65-4334-bf79-81fb40847a30', '1cd74dff-3116-4392-bfc9-89cf6affec92', '5fabdd2c-5176-4488-a331-e9a33566cc28'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:14 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:14 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "cinder-85015b93-212b-4d0b-8f95-b95ea56a0cf5-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-85015b93-212b-4d0b-8f95-b95ea56a0cf5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:15 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.348s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:15 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:15 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Deleted volume successfully. Jul 31 11:07:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-839bd2d6-e117-4eed-8b96-6e36e2748f82 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-cbaad987-d579-4734-a822-e4fe1c85e766-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "cinder-quobyte-85015b93-212b-4d0b-8f95-b95ea56a0cf5" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-quobyte-85015b93-212b-4d0b-8f95-b95ea56a0cf5" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:15 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc079dd-13cc-4667-9e3d-d13b0c256def]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:15 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5 Jul 31 11:07:15 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:15 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5" returned: 0 in 0.463s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:15 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5 Jul 31 11:07:15 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:16 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85015b93-212b-4d0b-8f95-b95ea56a0cf5" returned: 0 in 0.267s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-quobyte-85015b93-212b-4d0b-8f95-b95ea56a0cf5" released by "delete_volume" :: held 0.801s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Created reservations ['840047d1-b65d-44fb-aeb1-fcf4df2f5612', '41b3af86-7802-4e09-b231-4055d45579fd', 'a0890085-e14e-43b8-b4f4-ece38ebe01a0', 'c421a12b-9378-4974-a1d6-013782a786fa'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:16 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:16 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "cinder-4ee7dd19-2d62-45b1-b028-eeca998c5c5d-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-4ee7dd19-2d62-45b1-b028-eeca998c5c5d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "cinder-quobyte-4ee7dd19-2d62-45b1-b028-eeca998c5c5d" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-quobyte-4ee7dd19-2d62-45b1-b028-eeca998c5c5d" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4348c8-75ca-49bf-8cd2-8abd28c09bfe]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:16 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.354s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:16 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Deleted volume successfully. Jul 31 11:07:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f5d7babc-785a-4c8d-a87c-24de350c0579 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-85015b93-212b-4d0b-8f95-b95ea56a0cf5-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:16 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d Jul 31 11:07:16 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:17 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d" returned: 0 in 0.441s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:17 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d Jul 31 11:07:17 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:17 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4ee7dd19-2d62-45b1-b028-eeca998c5c5d" returned: 0 in 0.249s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-quobyte-4ee7dd19-2d62-45b1-b028-eeca998c5c5d" released by "delete_volume" :: held 0.734s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Created reservations ['00b546a4-a1b0-43ab-83a1-9dfa27a739ec', '31134ed1-3b65-4f7a-a2da-fa7d5cc495e4', '1f15fd30-d3ad-4511-941d-f315458c2f6d', '9ab6e244-93d0-43e7-853e-038ad1f18a47'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:17 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:17 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Acquiring lock "cinder-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Lock "cinder-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:17 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Acquiring lock "cinder-quobyte-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.336s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:17 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Deleted volume successfully. Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Lock "cinder-quobyte-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" acquired by "delete_volume" :: waited 0.032s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2034ef08-dd3d-41c3-8b2b-eaaabb8e20d0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-00b3889e-7013-49de-83bd-93892fd98f73 tempest-CreateVolumesFromImageTest-178634085 None] Lock "cinder-4ee7dd19-2d62-45b1-b028-eeca998c5c5d-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:17 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 Jul 31 11:07:17 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:18 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" returned: 0 in 0.390s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:18 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941 Jul 31 11:07:18 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:18 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" returned: 0 in 0.289s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Lock "cinder-quobyte-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941" released by "delete_volume" :: held 0.760s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Created reservations ['090b63c7-365b-46db-97a6-153856f3cbd1', '37196f6a-5593-4157-8d84-15cc9330252c', '6b4e4259-69db-4ef1-b0c2-f949198c7180', '4f379195-75f4-4f6c-8a5b-fd23695e0846'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:18 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:18 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:18 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.260s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:18 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Deleted volume successfully. Jul 31 11:07:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-db710ac0-972c-4c97-814c-d2a2e064b8bd tempest-TestStampPattern-14077229 None] Lock "cinder-9dcd5873-c8fb-4f43-bd01-41a9ecd5c941-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Flow 'volume_create_manager' (3b1c6aa0-87b3-4643-b251-31afdbe65cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512c0008-fffe-4401-b45a-7730a4216a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512c0008-fffe-4401-b45a-7730a4216a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d6608d-a3fa-49da-a6ee-fe728cc1d472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0729271a562a400bab59f3965c742d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:21Z,use_quota=True,user_id='b26dc02c797a4b7da6de81d5ad1327d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1d90ad-faf8-444f-9d92-4560d700b4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1d90ad-faf8-444f-9d92-4560d700b4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a273b5-99ba-4827-8b7e-f13201c052c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a273b5-99ba-4827-8b7e-f13201c052c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d6608d-a3fa-49da-a6ee-fe728cc1d472', 'volume_name': 'volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5984cff-83d6-4bb6-b717-88c95bfbebce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5984cff-83d6-4bb6-b717-88c95bfbebce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4726e40-d49f-4736-aa64-fffb2c52ef06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:20 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Volume 39d6608d-a3fa-49da-a6ee-fe728cc1d472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472', 'volume_size': 1} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d6608d-a3fa-49da-a6ee-fe728cc1d472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0729271a562a400bab59f3965c742d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:21Z,use_quota=True,user_id='b26dc02c797a4b7da6de81d5ad1327d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Creating volume 39d6608d-a3fa-49da-a6ee-fe728cc1d472 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:20 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:20 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472 1073741824 Jul 31 11:07:20 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:21 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472 1073741824" returned: 0 in 0.420s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:21 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472 Jul 31 11:07:21 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:21 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472" returned: 0 in 0.252s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4726e40-d49f-4736-aa64-fffb2c52ef06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69d6572-47ec-46d5-9007-fa7a6e810ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:21 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Volume volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472 (39d6608d-a3fa-49da-a6ee-fe728cc1d472): created successfully Jul 31 11:07:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69d6572-47ec-46d5-9007-fa7a6e810ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Flow 'volume_create_manager' (3b1c6aa0-87b3-4643-b251-31afdbe65cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:21 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-be73e93b-e88c-4122-8240-2bbdb12c6425 tempest-CinderUnicodeTest-879438763 None] Created volume successfully. Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Flow 'volume_create_manager' (e3d4637e-7611-4805-8385-6e70e42c4d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f439d657-de9e-4db4-965a-cebc5f7d7803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f439d657-de9e-4db4-965a-cebc5f7d7803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-23551138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b49db3a-9879-4750-b4ad-69b7e7d2b67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0729271a562a400bab59f3965c742d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:22Z,use_quota=True,user_id='b26dc02c797a4b7da6de81d5ad1327d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c47008-3750-4ce8-8589-85a8d33a5990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c47008-3750-4ce8-8589-85a8d33a5990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808d22b8-17ad-4448-8543-57d597bedfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808d22b8-17ad-4448-8543-57d597bedfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b49db3a-9879-4750-b4ad-69b7e7d2b67a', 'volume_name': 'volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1d4b47-bb28-4cb7-a94e-b1cd3c2c07a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1d4b47-bb28-4cb7-a94e-b1cd3c2c07a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5364a501-040b-4548-a6fd-596d6023239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:22 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Volume 3b49db3a-9879-4750-b4ad-69b7e7d2b67a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a', 'volume_size': 1} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-23551138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b49db3a-9879-4750-b4ad-69b7e7d2b67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0729271a562a400bab59f3965c742d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:22Z,use_quota=True,user_id='b26dc02c797a4b7da6de81d5ad1327d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Creating volume 3b49db3a-9879-4750-b4ad-69b7e7d2b67a {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:22 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:22 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a 1073741824 Jul 31 11:07:22 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:22 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a 1073741824" returned: 0 in 0.532s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:23 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a Jul 31 11:07:23 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:23 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a" returned: 0 in 0.253s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5364a501-040b-4548-a6fd-596d6023239a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd05973-7ba0-42da-a5cf-93b36ace5f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:23 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Volume volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a (3b49db3a-9879-4750-b4ad-69b7e7d2b67a): created successfully Jul 31 11:07:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd05973-7ba0-42da-a5cf-93b36ace5f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:23 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Flow 'volume_create_manager' (e3d4637e-7611-4805-8385-6e70e42c4d72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:23 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b3892130-e331-475e-b4e6-45b59e100b19 tempest-CinderUnicodeTest-879438763 None] Created volume successfully. Jul 31 11:07:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:24 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] Creating offline snapshot 2598d85f-5d67-480e-9365-8211467628cc of volume 3b49db3a-9879-4750-b4ad-69b7e7d2b67a {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:07:24 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeebb89-db2f-4f66-ac41-b3fc0b7f27f3]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:24 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a Jul 31 11:07:24 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:25 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a" returned: 0 in 0.367s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:25 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc 1G Jul 31 11:07:25 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:25 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc 1G" returned: 0 in 0.440s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:25 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc Jul 31 11:07:25 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:25 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc" returned: 0 in 0.329s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:25 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc is being set with open permissions: ugo+rw Jul 31 11:07:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:25 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc Jul 31 11:07:25 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:26 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc" returned: 0 in 0.256s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:26 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.info Jul 31 11:07:26 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:26 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.info" returned: 0 in 0.262s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:26 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.info is being set with open permissions: ugo+rw Jul 31 11:07:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:26 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.info Jul 31 11:07:26 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:26 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.info" returned: 0 in 0.261s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:26 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-40062c67-ecde-4a29-b967-c3783fb5b654 tempest-CinderUnicodeTest-879438763 None] Create snapshot completed successfully Jul 31 11:07:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "cinder-2598d85f-5d67-480e-9365-8211467628cc-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-2598d85f-5d67-480e-9365-8211467628cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "cinder-quobyte-3b49db3a-9879-4750-b4ad-69b7e7d2b67a" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-quobyte-3b49db3a-9879-4750-b4ad-69b7e7d2b67a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "cinder-quobyte-2598d85f-5d67-480e-9365-8211467628cc" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-quobyte-2598d85f-5d67-480e-9365-8211467628cc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Deleting offline snapshot 2598d85f-5d67-480e-9365-8211467628cc of volume 3b49db3a-9879-4750-b4ad-69b7e7d2b67a {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:07:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] snapshot_file for this snap is: volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:07:27 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e9001b-03e9-4348-a055-782041b2feec]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:28 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc Jul 31 11:07:28 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:28 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc" returned: 0 in 0.386s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:07:28 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab2ae99-e725-4d0c-bbf0-be7730952b3c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:28 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a Jul 31 11:07:28 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:28 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a" returned: 0 in 0.365s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:28 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc Jul 31 11:07:28 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:29 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc" returned: 0 in 0.346s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:29 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc Jul 31 11:07:29 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:29 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a.2598d85f-5d67-480e-9365-8211467628cc" returned: 0 in 0.256s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-quobyte-2598d85f-5d67-480e-9365-8211467628cc" released by "_delete_snapshot" :: held 1.481s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-quobyte-3b49db3a-9879-4750-b4ad-69b7e7d2b67a" released by "delete_snapshot" :: held 1.504s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Created reservations ['39add20a-ebb0-41f3-ba73-13c0ac5639ab', 'fa8dc894-1bac-4fb3-a2c5-bbba1ca86fcc', 'a11243b4-747f-4a61-a264-f22df0a405d4', '63a8af83-733d-4406-a8b6-878fbb39443b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Delete snapshot completed successfully. Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dc63030d-3e3c-4b5c-9672-4c1cf5bc1be6 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-2598d85f-5d67-480e-9365-8211467628cc-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Flow 'volume_create_manager' (3736f87a-2674-4ba5-b634-c68526ebb7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a16b60-be11-480a-9fb6-7665e6040ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a16b60-be11-480a-9fb6-7665e6040ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1222455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d68e35-08ec-4cd6-93a2-865f2846f533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425bb55f967646569bec73c597cd302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:30Z,use_quota=True,user_id='e43b0aa6a2014143bef2a167b0ce3704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed847ea-a1a9-4fb5-a339-38e01aad84c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed847ea-a1a9-4fb5-a339-38e01aad84c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9fc8e2-5ff0-477d-946a-b8a3380fbbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9fc8e2-5ff0-477d-946a-b8a3380fbbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d68e35-08ec-4cd6-93a2-865f2846f533', 'volume_name': 'volume-85d68e35-08ec-4cd6-93a2-865f2846f533', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0193203-ad1a-4103-9f54-e9304be2b08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0193203-ad1a-4103-9f54-e9304be2b08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0073fe-4531-4f10-b92c-56c713ece2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:29 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume 85d68e35-08ec-4cd6-93a2-865f2846f533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d68e35-08ec-4cd6-93a2-865f2846f533', 'volume_size': 1} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1222455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d68e35-08ec-4cd6-93a2-865f2846f533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425bb55f967646569bec73c597cd302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:30Z,use_quota=True,user_id='e43b0aa6a2014143bef2a167b0ce3704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Creating volume 85d68e35-08ec-4cd6-93a2-865f2846f533 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:29 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85d68e35-08ec-4cd6-93a2-865f2846f533 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:29 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85d68e35-08ec-4cd6-93a2-865f2846f533 1073741824 Jul 31 11:07:29 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "cinder-3b49db3a-9879-4750-b4ad-69b7e7d2b67a-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-3b49db3a-9879-4750-b4ad-69b7e7d2b67a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "cinder-quobyte-3b49db3a-9879-4750-b4ad-69b7e7d2b67a" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-quobyte-3b49db3a-9879-4750-b4ad-69b7e7d2b67a" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[307df2dd-7b85-4b2b-bf21-f06c1d8ad4f9]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:30 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a Jul 31 11:07:30 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:30 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85d68e35-08ec-4cd6-93a2-865f2846f533 1073741824" returned: 0 in 0.417s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85d68e35-08ec-4cd6-93a2-865f2846f533 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:30 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85d68e35-08ec-4cd6-93a2-865f2846f533 Jul 31 11:07:30 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:30 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a" returned: 0 in 0.382s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:30 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a Jul 31 11:07:30 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:30 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85d68e35-08ec-4cd6-93a2-865f2846f533" returned: 0 in 0.248s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0073fe-4531-4f10-b92c-56c713ece2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d68e35-08ec-4cd6-93a2-865f2846f533', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f15dea8-06a5-4934-9a82-8734c5157a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:30 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume volume-85d68e35-08ec-4cd6-93a2-865f2846f533 (85d68e35-08ec-4cd6-93a2-865f2846f533): created successfully Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f15dea8-06a5-4934-9a82-8734c5157a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Flow 'volume_create_manager' (3736f87a-2674-4ba5-b634-c68526ebb7f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:30 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e5a3a0b3-d61d-4ff1-88df-b5ce008e6282 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Created volume successfully. Jul 31 11:07:30 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3b49db3a-9879-4750-b4ad-69b7e7d2b67a" returned: 0 in 0.257s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-quobyte-3b49db3a-9879-4750-b4ad-69b7e7d2b67a" released by "delete_volume" :: held 0.692s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Created reservations ['6d2c0337-e804-4bfe-a73d-8f15ce007c69', 'e23be74a-9f8b-403e-b0c3-75e359276d4c', 'f47cf08e-0838-4dcc-85e8-dfb7989fc7c4', '960fa37b-83c5-4c6e-b265-8d97953bcd9b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:30 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:30 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:31 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.259s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:31 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Deleted volume successfully. Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-961e2be3-2af9-497a-bb34-8cab24242ee3 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-3b49db3a-9879-4750-b4ad-69b7e7d2b67a-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "cinder-39d6608d-a3fa-49da-a6ee-fe728cc1d472-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-39d6608d-a3fa-49da-a6ee-fe728cc1d472-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "cinder-quobyte-39d6608d-a3fa-49da-a6ee-fe728cc1d472" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-quobyte-39d6608d-a3fa-49da-a6ee-fe728cc1d472" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Flow 'volume_create_manager' (a8e5373a-e733-4f65-958f-1e0e70f5fb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc38243-d0b2-4fcc-af13-06dfad1b5902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6591db2-1929-4503-a78e-2b8aaa162549]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc38243-d0b2-4fcc-af13-06dfad1b5902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-142818619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68c81b3-034c-4d1a-ba4d-363015f457dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425bb55f967646569bec73c597cd302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:31Z,use_quota=True,user_id='e43b0aa6a2014143bef2a167b0ce3704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1042a3-ec83-4986-b8e3-658699b96f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1042a3-ec83-4986-b8e3-658699b96f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f124dc77-c597-4026-a8e5-34d66e38ac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f124dc77-c597-4026-a8e5-34d66e38ac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68c81b3-034c-4d1a-ba4d-363015f457dd', 'volume_name': 'volume-f68c81b3-034c-4d1a-ba4d-363015f457dd', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e565df9-e402-4350-81ca-6e3067329063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e565df9-e402-4350-81ca-6e3067329063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f446f6-1b92-419c-93f7-3167526b18ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:31 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume f68c81b3-034c-4d1a-ba4d-363015f457dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68c81b3-034c-4d1a-ba4d-363015f457dd', 'volume_size': 1} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-142818619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68c81b3-034c-4d1a-ba4d-363015f457dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425bb55f967646569bec73c597cd302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:31Z,use_quota=True,user_id='e43b0aa6a2014143bef2a167b0ce3704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Creating volume f68c81b3-034c-4d1a-ba4d-363015f457dd {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:31 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f68c81b3-034c-4d1a-ba4d-363015f457dd 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:31 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f68c81b3-034c-4d1a-ba4d-363015f457dd 1073741824 Jul 31 11:07:31 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:31 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472 Jul 31 11:07:31 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Flow 'volume_create_manager' (357c0c89-9c1f-4a86-965d-47611be6ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61809f39-d432-4e25-9fdc-352ec60444d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61809f39-d432-4e25-9fdc-352ec60444d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-848395264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897b8faf-4b0f-4823-87df-46076d4f2a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425bb55f967646569bec73c597cd302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:32Z,use_quota=True,user_id='e43b0aa6a2014143bef2a167b0ce3704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d666a9-59b6-426d-8cce-ee5085fcc7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d666a9-59b6-426d-8cce-ee5085fcc7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d113fe-eda8-49a5-b64b-6373daeae267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d113fe-eda8-49a5-b64b-6373daeae267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '897b8faf-4b0f-4823-87df-46076d4f2a86', 'volume_name': 'volume-897b8faf-4b0f-4823-87df-46076d4f2a86', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcb10a3-6f0b-4a87-9518-822f7dbe635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcb10a3-6f0b-4a87-9518-822f7dbe635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55203e8-b98d-4414-9f4e-07c7255e2e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:31 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume 897b8faf-4b0f-4823-87df-46076d4f2a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-897b8faf-4b0f-4823-87df-46076d4f2a86', 'volume_size': 1} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:31 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472" returned: 0 in 0.460s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:31 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472 Jul 31 11:07:31 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:31 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f68c81b3-034c-4d1a-ba4d-363015f457dd 1073741824" returned: 0 in 0.516s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f68c81b3-034c-4d1a-ba4d-363015f457dd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:31 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f68c81b3-034c-4d1a-ba4d-363015f457dd Jul 31 11:07:31 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Flow 'volume_create_manager' (4bbed810-8b3b-4126-811f-e4d3244413df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e80d79-af0f-4c07-a7e3-5f580232d5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:32 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-39d6608d-a3fa-49da-a6ee-fe728cc1d472" returned: 0 in 0.330s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e80d79-af0f-4c07-a7e3-5f580232d5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-355535384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a758443-1f23-4bb6-817a-62b5c70c8cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425bb55f967646569bec73c597cd302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:32Z,use_quota=True,user_id='e43b0aa6a2014143bef2a167b0ce3704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607b1d2d-b3bb-467b-abb3-b3e1e9737023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607b1d2d-b3bb-467b-abb3-b3e1e9737023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1129180b-5227-4501-a1b9-d04e5ea733b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1129180b-5227-4501-a1b9-d04e5ea733b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a758443-1f23-4bb6-817a-62b5c70c8cfd', 'volume_name': 'volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691c2d42-7cea-47bb-ad14-521dcb3913e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691c2d42-7cea-47bb-ad14-521dcb3913e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa868c1f-3bc5-4d33-9ad2-4afefbda6075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:32 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume 6a758443-1f23-4bb6-817a-62b5c70c8cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd', 'volume_size': 1} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-quobyte-39d6608d-a3fa-49da-a6ee-fe728cc1d472" released by "delete_volume" :: held 0.902s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Created reservations ['2f7e20b0-19cc-47e1-89c2-2a120481f441', 'f144cd3b-fe67-4d0c-8747-30af9fe433c4', 'e05b0641-34e3-49a5-9e64-9f7f86e635ce', '2fc7b897-ecdf-49bb-941c-58b586dc1ad9'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:32 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f68c81b3-034c-4d1a-ba4d-363015f457dd" returned: 0 in 0.377s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-848395264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897b8faf-4b0f-4823-87df-46076d4f2a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425bb55f967646569bec73c597cd302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:32Z,use_quota=True,user_id='e43b0aa6a2014143bef2a167b0ce3704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Creating volume 897b8faf-4b0f-4823-87df-46076d4f2a86 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:32 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-897b8faf-4b0f-4823-87df-46076d4f2a86 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f446f6-1b92-419c-93f7-3167526b18ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68c81b3-034c-4d1a-ba4d-363015f457dd', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:32 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-897b8faf-4b0f-4823-87df-46076d4f2a86 1073741824 Jul 31 11:07:32 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e11dbfe-2368-4794-ace0-4218b8d00978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:32 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume volume-f68c81b3-034c-4d1a-ba4d-363015f457dd (f68c81b3-034c-4d1a-ba4d-363015f457dd): created successfully Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e11dbfe-2368-4794-ace0-4218b8d00978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Flow 'volume_create_manager' (a8e5373a-e733-4f65-958f-1e0e70f5fb26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:32 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-eb83bb66-1a42-4a2a-aaad-3c123584c3a5 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Created volume successfully. Jul 31 11:07:32 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:32 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Flow 'volume_create_manager' (f96087be-d372-4173-8d91-a9966d89a428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c78e92-9302-4e9c-be4c-ce6effab770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c78e92-9302-4e9c-be4c-ce6effab770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1140604912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12728d20-ba98-4512-925a-991f8a60e0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425bb55f967646569bec73c597cd302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:32Z,use_quota=True,user_id='e43b0aa6a2014143bef2a167b0ce3704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd3df4c-6779-446e-af63-a47097f4ce8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd3df4c-6779-446e-af63-a47097f4ce8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9e6844-c6ae-44d3-b40b-4f996b129445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9e6844-c6ae-44d3-b40b-4f996b129445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12728d20-ba98-4512-925a-991f8a60e0c3', 'volume_name': 'volume-12728d20-ba98-4512-925a-991f8a60e0c3', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6fc914-dc2f-47c6-bede-2d296dcac825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6fc914-dc2f-47c6-bede-2d296dcac825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44220f82-e4d0-4b75-b97d-4615f89dafa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:32 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume 12728d20-ba98-4512-925a-991f8a60e0c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12728d20-ba98-4512-925a-991f8a60e0c3', 'volume_size': 1} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:32 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.332s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:32 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Deleted volume successfully. Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c59523fe-6304-4b99-a4ce-f3bd43d629d4 tempest-CinderUnicodeTest-879438763 None] Lock "cinder-39d6608d-a3fa-49da-a6ee-fe728cc1d472-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:32 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Flow 'volume_create_manager' (23d81fe2-cd88-4ebc-866f-583a9fe53579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fea927-9447-409e-9bdf-c759eab3de65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-897b8faf-4b0f-4823-87df-46076d4f2a86 1073741824" returned: 0 in 0.629s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fea927-9447-409e-9bdf-c759eab3de65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2036223621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2053a3d-976d-415b-a26a-79ffeb719aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425bb55f967646569bec73c597cd302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:33Z,use_quota=True,user_id='e43b0aa6a2014143bef2a167b0ce3704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6c5c27-f7ff-4914-b193-46ad80f60282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6c5c27-f7ff-4914-b193-46ad80f60282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204b8e6b-065d-43ec-b071-aba325281599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204b8e6b-065d-43ec-b071-aba325281599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2053a3d-976d-415b-a26a-79ffeb719aec', 'volume_name': 'volume-b2053a3d-976d-415b-a26a-79ffeb719aec', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090867f2-976a-4fdd-b9a3-a5a257029a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090867f2-976a-4fdd-b9a3-a5a257029a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59659d03-196a-4abf-8060-51d943b13f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:33 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume b2053a3d-976d-415b-a26a-79ffeb719aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2053a3d-976d-415b-a26a-79ffeb719aec', 'volume_size': 1} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-897b8faf-4b0f-4823-87df-46076d4f2a86 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:33 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-897b8faf-4b0f-4823-87df-46076d4f2a86 Jul 31 11:07:33 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:33 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-897b8faf-4b0f-4823-87df-46076d4f2a86" returned: 0 in 0.230s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.140s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-355535384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a758443-1f23-4bb6-817a-62b5c70c8cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425bb55f967646569bec73c597cd302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:32Z,use_quota=True,user_id='e43b0aa6a2014143bef2a167b0ce3704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Creating volume 6a758443-1f23-4bb6-817a-62b5c70c8cfd {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:33 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55203e8-b98d-4414-9f4e-07c7255e2e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897b8faf-4b0f-4823-87df-46076d4f2a86', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:33 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd 1073741824 Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0399df7-afc2-4f18-ba5e-a1ae61a71514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:33 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:33 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume volume-897b8faf-4b0f-4823-87df-46076d4f2a86 (897b8faf-4b0f-4823-87df-46076d4f2a86): created successfully Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0399df7-afc2-4f18-ba5e-a1ae61a71514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Flow 'volume_create_manager' (357c0c89-9c1f-4a86-965d-47611be6ac40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:33 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-89ae69e9-e22a-4a24-b839-fd97b0d2d637 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Created volume successfully. Jul 31 11:07:33 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd 1073741824" returned: 0 in 0.463s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:33 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd Jul 31 11:07:33 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:34 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd" returned: 0 in 0.263s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.428s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1140604912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12728d20-ba98-4512-925a-991f8a60e0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425bb55f967646569bec73c597cd302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:32Z,use_quota=True,user_id='e43b0aa6a2014143bef2a167b0ce3704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Creating volume 12728d20-ba98-4512-925a-991f8a60e0c3 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:34 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-12728d20-ba98-4512-925a-991f8a60e0c3 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa868c1f-3bc5-4d33-9ad2-4afefbda6075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1e3450-461c-463f-8192-258ae967b27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:34 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-12728d20-ba98-4512-925a-991f8a60e0c3 1073741824 Jul 31 11:07:34 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:34 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd (6a758443-1f23-4bb6-817a-62b5c70c8cfd): created successfully Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1e3450-461c-463f-8192-258ae967b27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Flow 'volume_create_manager' (4bbed810-8b3b-4126-811f-e4d3244413df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:34 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-50635be0-99f7-4def-ae96-b1bf1e5f50e7 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Created volume successfully. Jul 31 11:07:34 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-12728d20-ba98-4512-925a-991f8a60e0c3 1073741824" returned: 0 in 0.483s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-12728d20-ba98-4512-925a-991f8a60e0c3 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:34 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-12728d20-ba98-4512-925a-991f8a60e0c3 Jul 31 11:07:34 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:34 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-12728d20-ba98-4512-925a-991f8a60e0c3" returned: 0 in 0.286s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.851s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2036223621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2053a3d-976d-415b-a26a-79ffeb719aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425bb55f967646569bec73c597cd302b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:33Z,use_quota=True,user_id='e43b0aa6a2014143bef2a167b0ce3704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Creating volume b2053a3d-976d-415b-a26a-79ffeb719aec {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:34 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b2053a3d-976d-415b-a26a-79ffeb719aec 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44220f82-e4d0-4b75-b97d-4615f89dafa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12728d20-ba98-4512-925a-991f8a60e0c3', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:34 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b2053a3d-976d-415b-a26a-79ffeb719aec 1073741824 Jul 31 11:07:34 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c133f7-fd0b-487c-97a2-eec2b6ac8f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:34 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume volume-12728d20-ba98-4512-925a-991f8a60e0c3 (12728d20-ba98-4512-925a-991f8a60e0c3): created successfully Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c133f7-fd0b-487c-97a2-eec2b6ac8f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Flow 'volume_create_manager' (f96087be-d372-4173-8d91-a9966d89a428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:34 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-fc06f862-2f82-42e3-8d11-0e89d1ed5217 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Created volume successfully. Jul 31 11:07:35 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b2053a3d-976d-415b-a26a-79ffeb719aec 1073741824" returned: 0 in 0.453s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b2053a3d-976d-415b-a26a-79ffeb719aec {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:35 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b2053a3d-976d-415b-a26a-79ffeb719aec Jul 31 11:07:35 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:35 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b2053a3d-976d-415b-a26a-79ffeb719aec" returned: 0 in 0.245s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59659d03-196a-4abf-8060-51d943b13f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2053a3d-976d-415b-a26a-79ffeb719aec', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70809839-c6ec-4d7a-a094-27335836c97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:35 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Volume volume-b2053a3d-976d-415b-a26a-79ffeb719aec (b2053a3d-976d-415b-a26a-79ffeb719aec): created successfully Jul 31 11:07:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70809839-c6ec-4d7a-a094-27335836c97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Flow 'volume_create_manager' (23d81fe2-cd88-4ebc-866f-583a9fe53579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:35 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ea2af470-411e-450a-8232-7010a4d1c3ea tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Created volume successfully. Jul 31 11:07:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "cinder-b2053a3d-976d-415b-a26a-79ffeb719aec-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-b2053a3d-976d-415b-a26a-79ffeb719aec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "cinder-quobyte-b2053a3d-976d-415b-a26a-79ffeb719aec" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:36 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-quobyte-b2053a3d-976d-415b-a26a-79ffeb719aec" acquired by "delete_volume" :: waited 0.013s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:36 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afd2f11-3fac-4635-91a4-3dde521b202c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b2053a3d-976d-415b-a26a-79ffeb719aec {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:36 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b2053a3d-976d-415b-a26a-79ffeb719aec Jul 31 11:07:36 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:36 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b2053a3d-976d-415b-a26a-79ffeb719aec" returned: 0 in 0.367s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b2053a3d-976d-415b-a26a-79ffeb719aec {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:36 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b2053a3d-976d-415b-a26a-79ffeb719aec Jul 31 11:07:36 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:37 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b2053a3d-976d-415b-a26a-79ffeb719aec" returned: 0 in 0.247s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-quobyte-b2053a3d-976d-415b-a26a-79ffeb719aec" released by "delete_volume" :: held 0.652s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Created reservations ['564b89d1-bf41-4206-be06-8c653a11f6f7', '7b467c8a-a6d6-4442-8b43-2014d6db1097', 'f6f13446-e4a9-474c-a058-9b091211a710', '80662cbc-7b6f-4111-8e3c-08fda65c8523'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:37 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:37 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:37 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.248s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:37 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Deleted volume successfully. Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-abe70971-c22b-4e7e-90f9-52924dd7292b tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-b2053a3d-976d-415b-a26a-79ffeb719aec-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "cinder-12728d20-ba98-4512-925a-991f8a60e0c3-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-12728d20-ba98-4512-925a-991f8a60e0c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "cinder-quobyte-12728d20-ba98-4512-925a-991f8a60e0c3" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-quobyte-12728d20-ba98-4512-925a-991f8a60e0c3" acquired by "delete_volume" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85adb76-adc6-4d4b-bcb0-2c9c35806fa4]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-12728d20-ba98-4512-925a-991f8a60e0c3 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:37 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-12728d20-ba98-4512-925a-991f8a60e0c3 Jul 31 11:07:37 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:37 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-12728d20-ba98-4512-925a-991f8a60e0c3" returned: 0 in 0.364s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-12728d20-ba98-4512-925a-991f8a60e0c3 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:37 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-12728d20-ba98-4512-925a-991f8a60e0c3 Jul 31 11:07:37 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:38 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-12728d20-ba98-4512-925a-991f8a60e0c3" returned: 0 in 0.236s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-quobyte-12728d20-ba98-4512-925a-991f8a60e0c3" released by "delete_volume" :: held 0.639s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Created reservations ['281ee0a7-a600-45fe-b437-65fc7ccbc26f', '4ba9726b-0086-47f2-8887-15e7e314eb33', '1e60d822-9244-4c7f-b0a4-05626c9aafca', '1744c2e6-4d26-4ba9-990a-3fa550fcf12d'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:38 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:38 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:38 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.262s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Deleted volume successfully. Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5ce7d35d-56cf-462b-8803-776e323259be tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-12728d20-ba98-4512-925a-991f8a60e0c3-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "cinder-6a758443-1f23-4bb6-817a-62b5c70c8cfd-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-6a758443-1f23-4bb6-817a-62b5c70c8cfd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "cinder-quobyte-6a758443-1f23-4bb6-817a-62b5c70c8cfd" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-quobyte-6a758443-1f23-4bb6-817a-62b5c70c8cfd" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[295bf9ba-e2eb-4952-a4d4-d7396c86ed2b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:38 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd Jul 31 11:07:38 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:39 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd" returned: 0 in 0.338s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:39 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd Jul 31 11:07:39 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:39 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-6a758443-1f23-4bb6-817a-62b5c70c8cfd" returned: 0 in 0.230s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-quobyte-6a758443-1f23-4bb6-817a-62b5c70c8cfd" released by "delete_volume" :: held 0.607s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Created reservations ['32ea5b45-bcdd-4be2-801d-175315ea4360', '7a087f7e-9b1a-40af-ab32-199b9e83988e', '00fc58cf-dc0e-436f-939d-a537aa9dda37', '9d9a10e1-43a4-4df2-8542-e0965310d59a'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:39 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:39 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:39 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.239s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Deleted volume successfully. Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9862c61a-46b0-4080-934d-7513bbeddbff tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-6a758443-1f23-4bb6-817a-62b5c70c8cfd-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "cinder-897b8faf-4b0f-4823-87df-46076d4f2a86-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-897b8faf-4b0f-4823-87df-46076d4f2a86-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "cinder-quobyte-897b8faf-4b0f-4823-87df-46076d4f2a86" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-quobyte-897b8faf-4b0f-4823-87df-46076d4f2a86" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a126bd71-717c-442e-b082-5ac04c412168]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-897b8faf-4b0f-4823-87df-46076d4f2a86 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:40 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-897b8faf-4b0f-4823-87df-46076d4f2a86 Jul 31 11:07:40 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:40 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-897b8faf-4b0f-4823-87df-46076d4f2a86" returned: 0 in 0.350s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-897b8faf-4b0f-4823-87df-46076d4f2a86 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:40 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-897b8faf-4b0f-4823-87df-46076d4f2a86 Jul 31 11:07:40 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:40 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-897b8faf-4b0f-4823-87df-46076d4f2a86" returned: 0 in 0.241s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-quobyte-897b8faf-4b0f-4823-87df-46076d4f2a86" released by "delete_volume" :: held 0.625s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Created reservations ['46629352-96e4-4216-8aff-0aa3efeab6bd', '8e66f1f7-14ec-406e-989f-2ce65024b041', '6dd8a837-2c0b-4713-9191-de9e2e1ab50b', '7f6767f9-62b9-43d2-a2e4-e599e484a5c0'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:40 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:40 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:40 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.233s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:40 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Deleted volume successfully. Jul 31 11:07:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5af355f3-a2c0-4699-a808-01aeb52c505d tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-897b8faf-4b0f-4823-87df-46076d4f2a86-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "cinder-f68c81b3-034c-4d1a-ba4d-363015f457dd-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-f68c81b3-034c-4d1a-ba4d-363015f457dd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "cinder-quobyte-f68c81b3-034c-4d1a-ba4d-363015f457dd" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-quobyte-f68c81b3-034c-4d1a-ba4d-363015f457dd" acquired by "delete_volume" :: waited 0.013s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0fddad-26ad-4d5e-9a5f-e565a7b394fb]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f68c81b3-034c-4d1a-ba4d-363015f457dd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:41 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f68c81b3-034c-4d1a-ba4d-363015f457dd Jul 31 11:07:41 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:41 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f68c81b3-034c-4d1a-ba4d-363015f457dd" returned: 0 in 0.343s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f68c81b3-034c-4d1a-ba4d-363015f457dd {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:41 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f68c81b3-034c-4d1a-ba4d-363015f457dd Jul 31 11:07:41 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:41 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f68c81b3-034c-4d1a-ba4d-363015f457dd" returned: 0 in 0.232s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-quobyte-f68c81b3-034c-4d1a-ba4d-363015f457dd" released by "delete_volume" :: held 0.612s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Created reservations ['39a73e48-14ed-4706-b62f-4a98d9e221be', '554fca08-32e6-44e2-b524-c80503d45fb9', '4bbf86d8-339f-4d0d-b443-27a4f55416b7', '76b08424-13d8-466f-bf88-399115cd9af3'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:41 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:41 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:42 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.228s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Deleted volume successfully. Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-286f2daf-4d3a-4a31-9fce-bd026fbca62e tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-f68c81b3-034c-4d1a-ba4d-363015f457dd-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "cinder-85d68e35-08ec-4cd6-93a2-865f2846f533-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-85d68e35-08ec-4cd6-93a2-865f2846f533-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "cinder-quobyte-85d68e35-08ec-4cd6-93a2-865f2846f533" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-quobyte-85d68e35-08ec-4cd6-93a2-865f2846f533" acquired by "delete_volume" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[959316df-9e6d-472d-bfa7-9400ff5202be]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85d68e35-08ec-4cd6-93a2-865f2846f533 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:42 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85d68e35-08ec-4cd6-93a2-865f2846f533 Jul 31 11:07:42 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:42 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85d68e35-08ec-4cd6-93a2-865f2846f533" returned: 0 in 0.343s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85d68e35-08ec-4cd6-93a2-865f2846f533 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:42 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85d68e35-08ec-4cd6-93a2-865f2846f533 Jul 31 11:07:42 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:42 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-85d68e35-08ec-4cd6-93a2-865f2846f533" returned: 0 in 0.232s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-quobyte-85d68e35-08ec-4cd6-93a2-865f2846f533" released by "delete_volume" :: held 0.612s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Created reservations ['a369cb3d-ca3b-47cb-a146-ee7d13cb8600', '0d1a1ee5-2fb2-49ce-aa51-0f1b9d308058', '0c36448a-f24e-4560-a714-75198ceabaee', '1cd4eb0a-5232-454b-b6ca-01cd68376a08'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:42 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:07:42 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:43 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:43 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:43 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Deleted volume successfully. Jul 31 11:07:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6153b9bf-3f90-42cf-a418-d0db69ed9a13 tempest-CreateVolumesFromSourceVolumeTest-1728520264 None] Lock "cinder-85d68e35-08ec-4cd6-93a2-865f2846f533-delete_volume" released by "delete_volume" :: held 1.030s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:52 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=190,cinder:SELECT=136,cinder:INSERT=49,cinder:DELETE=14 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:07:53 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=135,cinder:INSERT=48,cinder:UPDATE=182,cinder:DELETE=17 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Flow 'volume_create_manager' (31cff089-6e4e-4b60-b1b1-3a539bc93d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452a39da-c346-4bf8-9c9a-82969bea2ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452a39da-c346-4bf8-9c9a-82969bea2ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-294342687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9397f936-5c18-4114-9c1d-41a740bf678e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883edbccedf946dd80921235d7997353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:02Z,use_quota=True,user_id='c901f37461b146a19f3f4b10ce0bae3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd9d61b-c4a3-4f83-aa1e-7ad3c6b1e0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd9d61b-c4a3-4f83-aa1e-7ad3c6b1e0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac7929f-4195-4ef8-abb1-02f31f1b0b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac7929f-4195-4ef8-abb1-02f31f1b0b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9397f936-5c18-4114-9c1d-41a740bf678e', 'volume_name': 'volume-9397f936-5c18-4114-9c1d-41a740bf678e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bb1924-2ad5-4e5c-8735-fd04983087bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bb1924-2ad5-4e5c-8735-fd04983087bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fc8fd9-69fd-433c-9897-2725c805f563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:02 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Volume 9397f936-5c18-4114-9c1d-41a740bf678e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9397f936-5c18-4114-9c1d-41a740bf678e', 'volume_size': 1} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-294342687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9397f936-5c18-4114-9c1d-41a740bf678e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883edbccedf946dd80921235d7997353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:02Z,use_quota=True,user_id='c901f37461b146a19f3f4b10ce0bae3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Creating volume 9397f936-5c18-4114-9c1d-41a740bf678e {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:02 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:02 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e 1073741824 Jul 31 11:08:02 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:02 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e 1073741824" returned: 0 in 0.417s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:02 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e Jul 31 11:08:02 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:02 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e" returned: 0 in 0.245s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fc8fd9-69fd-433c-9897-2725c805f563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9397f936-5c18-4114-9c1d-41a740bf678e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c759c33-0a6e-4d4e-b09a-4e4d514f093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:02 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Volume volume-9397f936-5c18-4114-9c1d-41a740bf678e (9397f936-5c18-4114-9c1d-41a740bf678e): created successfully Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c759c33-0a6e-4d4e-b09a-4e4d514f093d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Flow 'volume_create_manager' (31cff089-6e4e-4b60-b1b1-3a539bc93d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:02 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-0279e571-4eae-4a72-b7ac-0015cef35813 tempest-SnapshotDependencyTests-1008107165 None] Created volume successfully. Jul 31 11:08:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] Creating offline snapshot 61faa6cd-8358-4740-9aa4-a7868f1a72c1 of volume 9397f936-5c18-4114-9c1d-41a740bf678e {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:08:03 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23fa76e-ee22-4186-b737-ac5610f8d008]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:03 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e Jul 31 11:08:03 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:03 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e" returned: 0 in 0.361s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:03 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 1G Jul 31 11:08:03 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:04 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 1G" returned: 0 in 0.387s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9397f936-5c18-4114-9c1d-41a740bf678e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:04 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9397f936-5c18-4114-9c1d-41a740bf678e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 Jul 31 11:08:04 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:04 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9397f936-5c18-4114-9c1d-41a740bf678e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1" returned: 0 in 0.277s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:04 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 is being set with open permissions: ugo+rw Jul 31 11:08:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:04 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 Jul 31 11:08:04 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:04 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1" returned: 0 in 0.226s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:04 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.info Jul 31 11:08:04 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:04 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.info" returned: 0 in 0.245s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:04 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.info is being set with open permissions: ugo+rw Jul 31 11:08:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:04 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.info Jul 31 11:08:04 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:05 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.info" returned: 0 in 0.230s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:05 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-409062ba-0ed8-43aa-8ef0-2b48ebc27590 tempest-SnapshotDependencyTests-1008107165 None] Create snapshot completed successfully Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Flow 'volume_create_manager' (8be8c964-622c-4c72-bd7d-84d092bf4c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432890f3-bdd7-4959-9f23-3bb95707560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432890f3-bdd7-4959-9f23-3bb95707560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c188512-b720-44ea-bc17-a6a0ceb39a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883edbccedf946dd80921235d7997353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=61faa6cd-8358-4740-9aa4-a7868f1a72c1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:06Z,use_quota=True,user_id='c901f37461b146a19f3f4b10ce0bae3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6dda9e-d8c1-4803-85a3-92ae84c69d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6dda9e-d8c1-4803-85a3-92ae84c69d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64679146-b152-48f5-8fd2-a1f0fea53e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64679146-b152-48f5-8fd2-a1f0fea53e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1c188512-b720-44ea-bc17-a6a0ceb39a3e', 'volume_name': 'volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e', 'volume_size': 1, 'snapshot_id': '61faa6cd-8358-4740-9aa4-a7868f1a72c1'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1bfb24-af9f-4724-a9ab-e97d2241ed37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1bfb24-af9f-4724-a9ab-e97d2241ed37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74580071-962f-44a6-88af-b9f0ddbf4cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:06 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Volume 1c188512-b720-44ea-bc17-a6a0ceb39a3e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e', 'volume_size': 1, 'snapshot_id': '61faa6cd-8358-4740-9aa4-a7868f1a72c1'} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "cinder-quobyte-61faa6cd-8358-4740-9aa4-a7868f1a72c1-1c188512-b720-44ea-bc17-a6a0ceb39a3e" by "_create_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-quobyte-61faa6cd-8358-4740-9aa4-a7868f1a72c1-1c188512-b720-44ea-bc17-a6a0ceb39a3e" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Creating volume 1c188512-b720-44ea-bc17-a6a0ceb39a3e from snapshot 61faa6cd-8358-4740-9aa4-a7868f1a72c1 {{(pid=89145) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "cinder-quobyte-1c188512-b720-44ea-bc17-a6a0ceb39a3e" by "_copy_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-quobyte-1c188512-b720-44ea-bc17-a6a0ceb39a3e" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] snapshot: 61faa6cd-8358-4740-9aa4-a7868f1a72c1, volume: 1c188512-b720-44ea-bc17-a6a0ceb39a3e, {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9add99a-ba77-4e5b-baa1-9d9c8f495b3a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:06 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 Jul 31 11:08:06 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:06 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1" returned: 0 in 0.342s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9397f936-5c18-4114-9c1d-41a740bf678e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Creating direct copy from snapshot {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc14d764-32f5-4166-ac36-df0512150482]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:06 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e Jul 31 11:08:06 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:06 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e" returned: 0 in 0.346s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG cinder.utils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Path /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e not found in is_blk_device check {{(pid=89145) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:08:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:06 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e Jul 31 11:08:06 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:08:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:08 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:08 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:08 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.583s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:08:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:08:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:08:10 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e" returned: 0 in 3.953s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:10 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3be911-81bc-4a10-8422-46f1df5582fe]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:10 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e Jul 31 11:08:10 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:11 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e" returned: 0 in 0.521s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:11 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e, size 1024.00 MB, duration 3.95 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:08:11 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Converted 1024.00 MB image at 259.00 MB/s Jul 31 11:08:11 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e is being set with open permissions: ugo+rw Jul 31 11:08:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:11 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e Jul 31 11:08:11 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:11 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e" returned: 0 in 0.240s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-quobyte-1c188512-b720-44ea-bc17-a6a0ceb39a3e" released by "_copy_volume_from_snapshot" :: held 5.490s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-quobyte-61faa6cd-8358-4740-9aa4-a7868f1a72c1-1c188512-b720-44ea-bc17-a6a0ceb39a3e" released by "_create_volume_from_snapshot" :: held 5.517s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.531s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74580071-962f-44a6-88af-b9f0ddbf4cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e', 'volume_size': 1, 'snapshot_id': '61faa6cd-8358-4740-9aa4-a7868f1a72c1'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e08bc5-f387-474a-ad14-ef48e5082eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:11 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Volume volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e (1c188512-b720-44ea-bc17-a6a0ceb39a3e): created successfully Jul 31 11:08:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e08bc5-f387-474a-ad14-ef48e5082eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Flow 'volume_create_manager' (8be8c964-622c-4c72-bd7d-84d092bf4c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:11 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-964bb728-178e-4ef3-99a3-feff0873335e tempest-SnapshotDependencyTests-1008107165 None] Created volume successfully. Jul 31 11:08:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "cinder-61faa6cd-8358-4740-9aa4-a7868f1a72c1-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-61faa6cd-8358-4740-9aa4-a7868f1a72c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "cinder-quobyte-9397f936-5c18-4114-9c1d-41a740bf678e" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-quobyte-9397f936-5c18-4114-9c1d-41a740bf678e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "cinder-quobyte-61faa6cd-8358-4740-9aa4-a7868f1a72c1" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-quobyte-61faa6cd-8358-4740-9aa4-a7868f1a72c1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Deleting offline snapshot 61faa6cd-8358-4740-9aa4-a7868f1a72c1 of volume 9397f936-5c18-4114-9c1d-41a740bf678e {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:08:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] snapshot_file for this snap is: volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:08:12 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[afed596f-1f9a-4800-ae5e-8a74aad5d574]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:12 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 Jul 31 11:08:12 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:13 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1" returned: 0 in 0.350s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9397f936-5c18-4114-9c1d-41a740bf678e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:08:13 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d07c1e-db75-418d-a3b1-4f4283bc8dfe]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:13 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e Jul 31 11:08:13 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:13 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e" returned: 0 in 0.340s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:13 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 Jul 31 11:08:13 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:13 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1" returned: 0 in 0.331s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:13 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1 Jul 31 11:08:13 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:13 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e.61faa6cd-8358-4740-9aa4-a7868f1a72c1" returned: 0 in 0.234s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-quobyte-61faa6cd-8358-4740-9aa4-a7868f1a72c1" released by "_delete_snapshot" :: held 1.348s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-quobyte-9397f936-5c18-4114-9c1d-41a740bf678e" released by "delete_snapshot" :: held 1.372s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:14 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Created reservations ['997c3f94-45e9-4556-b831-f2c062fca061', 'f98ad5bc-10dc-4146-9ef8-2ebcf12aebaa', '2576bdbc-1508-4651-beb1-74d163297f99', '95a67aa3-1e19-4fd1-b3c5-45f14de634d0'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:14 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Delete snapshot completed successfully. Jul 31 11:08:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e8428a0f-2aed-4597-8bc8-620c09adcf03 tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-61faa6cd-8358-4740-9aa4-a7868f1a72c1-delete_snapshot" released by "delete_snapshot" :: held 1.493s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "cinder-9397f936-5c18-4114-9c1d-41a740bf678e-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-9397f936-5c18-4114-9c1d-41a740bf678e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "cinder-quobyte-9397f936-5c18-4114-9c1d-41a740bf678e" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-quobyte-9397f936-5c18-4114-9c1d-41a740bf678e" acquired by "delete_volume" :: waited 0.013s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:14 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[18481c2b-3aa8-4926-adaa-e4f3de207eda]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:14 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e Jul 31 11:08:14 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:15 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e" returned: 0 in 0.336s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:15 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e Jul 31 11:08:15 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:15 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-9397f936-5c18-4114-9c1d-41a740bf678e" returned: 0 in 0.268s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-quobyte-9397f936-5c18-4114-9c1d-41a740bf678e" released by "delete_volume" :: held 0.658s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Created reservations ['419d063f-15d4-4d51-a462-c850e9bc0e6b', '51203bc4-ff50-486a-b68a-76cbafa32347', '3bdd2c6c-d0c5-4f86-8c6d-35612eaa4cb7', '8d84b230-c2fb-4565-88a3-8cd0f82319b5'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:15 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:15 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:15 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.263s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:15 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Deleted volume successfully. Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3458d709-4073-450c-af68-da088614fab7 tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-9397f936-5c18-4114-9c1d-41a740bf678e-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "cinder-1c188512-b720-44ea-bc17-a6a0ceb39a3e-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-1c188512-b720-44ea-bc17-a6a0ceb39a3e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "cinder-quobyte-1c188512-b720-44ea-bc17-a6a0ceb39a3e" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-quobyte-1c188512-b720-44ea-bc17-a6a0ceb39a3e" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dc13cc-236e-4e05-9dc6-712f8daa5ef6]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:16 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e Jul 31 11:08:16 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:16 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e" returned: 0 in 0.352s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:16 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e Jul 31 11:08:16 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:16 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1c188512-b720-44ea-bc17-a6a0ceb39a3e" returned: 0 in 0.251s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-quobyte-1c188512-b720-44ea-bc17-a6a0ceb39a3e" released by "delete_volume" :: held 0.641s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Created reservations ['8686fa1e-148a-489a-869d-da0108877526', 'f4600677-4aaa-4e71-8913-62fb00ffec7b', 'f158aeab-a484-4339-8e93-eb461505c031', '02d1fc2b-d3e3-402a-bff4-031002485342'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:16 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:16 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:16 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.237s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:16 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:16 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Deleted volume successfully. Jul 31 11:08:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4e3a9f98-64b5-4728-acb4-27418deb1a3a tempest-SnapshotDependencyTests-1008107165 None] Lock "cinder-1c188512-b720-44ea-bc17-a6a0ceb39a3e-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:26 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=24,cinder:INSERT=9,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:08:26 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=32,cinder:SELECT=23,cinder:DELETE=4,cinder:INSERT=5 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Flow 'volume_create_manager' (acadb0fc-2c5b-4a6f-aa7a-636766531ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863e332a-85c7-48a2-ab9c-d6582e1c0206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863e332a-85c7-48a2-ab9c-d6582e1c0206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-123302213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165b1a3a-162a-4189-9522-bdeecfddfe31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e239d1e7d98b4d858e8b4358f7983631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:36Z,use_quota=True,user_id='d32cdce3051249cb9630cdf16dc09700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b311f2a8-baad-4c91-b053-f1ad0e4f58ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b311f2a8-baad-4c91-b053-f1ad0e4f58ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249a4607-e675-40f8-99ed-7048b0a825f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249a4607-e675-40f8-99ed-7048b0a825f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165b1a3a-162a-4189-9522-bdeecfddfe31', 'volume_name': 'volume-165b1a3a-162a-4189-9522-bdeecfddfe31', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af3bac5-6a98-42dd-a359-bf71160cb312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af3bac5-6a98-42dd-a359-bf71160cb312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ea6c5b-d818-4a36-bb13-2f98b4000d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:35 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume 165b1a3a-162a-4189-9522-bdeecfddfe31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165b1a3a-162a-4189-9522-bdeecfddfe31', 'volume_size': 1} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-123302213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165b1a3a-162a-4189-9522-bdeecfddfe31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e239d1e7d98b4d858e8b4358f7983631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:36Z,use_quota=True,user_id='d32cdce3051249cb9630cdf16dc09700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Creating volume 165b1a3a-162a-4189-9522-bdeecfddfe31 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:35 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:35 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 1073741824 Jul 31 11:08:35 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Flow 'volume_create_manager' (1b93d5d1-4183-4b4d-a24c-8cfeb6fe6c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5d2610-acdf-473c-b94d-76a1330b807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5d2610-acdf-473c-b94d-76a1330b807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1316639511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ffdaa2-16de-4b04-a122-16674b0f2b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2321249f8ab141f4ad554c8cade9eb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:36Z,use_quota=True,user_id='fe0f8bd2fff04ae4b334b4e3eb1b3fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fc2efb-5f2b-4f12-963c-ac3b4f0ac41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fc2efb-5f2b-4f12-963c-ac3b4f0ac41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72cab98a-22a5-48be-90b7-078b806845f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72cab98a-22a5-48be-90b7-078b806845f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ffdaa2-16de-4b04-a122-16674b0f2b01', 'volume_name': 'volume-56ffdaa2-16de-4b04-a122-16674b0f2b01', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3e2250-c0cf-4552-bf02-bc55a9baa7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3e2250-c0cf-4552-bf02-bc55a9baa7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068906df-1471-493c-ac92-e59c6c199dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:35 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Volume 56ffdaa2-16de-4b04-a122-16674b0f2b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ffdaa2-16de-4b04-a122-16674b0f2b01', 'volume_size': 1} Jul 31 11:08:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Flow 'volume_create_manager' (855651fb-cff1-4e0a-bb6f-2f2093db5805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0cc70a-f914-4263-bc5c-e34574c757c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0cc70a-f914-4263-bc5c-e34574c757c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1350797086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2321249f8ab141f4ad554c8cade9eb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:36Z,use_quota=True,user_id='fe0f8bd2fff04ae4b334b4e3eb1b3fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d009b610-73c9-49c8-b4ad-f3e8c07eadf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d009b610-73c9-49c8-b4ad-f3e8c07eadf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4ff262-82eb-43d3-9e2a-517a039a62ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4ff262-82eb-43d3-9e2a-517a039a62ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4', 'volume_name': 'volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf3f1da-deb1-4457-a3ff-ad76ed9fe580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf3f1da-deb1-4457-a3ff-ad76ed9fe580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03911d0-bd15-4c49-aba3-8f4c8025f414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Volume 3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4', 'volume_size': 1} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Flow 'volume_create_manager' (bf863a1f-7d8a-4909-aa1f-b30a7453a505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:36 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34896a3-fcf4-43e1-bef0-512ec5b35634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 1073741824" returned: 0 in 0.689s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34896a3-fcf4-43e1-bef0-512ec5b35634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039781175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086d3279-cdcc-4a8e-b876-fff34b0fa99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3656530330f14ebabffe305829f522ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:36Z,use_quota=True,user_id='72fd95dcc6a04db9bc1df6e0a8a3a95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a6b02f-663d-48db-bd93-a85ca5d67f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a6b02f-663d-48db-bd93-a85ca5d67f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e72343-832f-4eca-80a1-33907fd3d7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e72343-832f-4eca-80a1-33907fd3d7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086d3279-cdcc-4a8e-b876-fff34b0fa99c', 'volume_name': 'volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7976e76d-32cf-4b12-840d-99fc62270d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7976e76d-32cf-4b12-840d-99fc62270d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef73c2be-f047-453f-a807-16fa35556bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume 086d3279-cdcc-4a8e-b876-fff34b0fa99c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c', 'volume_size': 1} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:36 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 Jul 31 11:08:36 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Flow 'volume_create_manager' (b742ef82-8497-4cc3-8a7b-f4697daf24cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72089fec-3bd3-4176-82c4-51de8cedfc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72089fec-3bd3-4176-82c4-51de8cedfc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1848476640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114efaa3-b402-4be6-ae93-e156902e0bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2321249f8ab141f4ad554c8cade9eb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:37Z,use_quota=True,user_id='fe0f8bd2fff04ae4b334b4e3eb1b3fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989933f8-9473-44b2-a300-576b466e502e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989933f8-9473-44b2-a300-576b466e502e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15196607-98a1-4171-a68b-a9fa7d18480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15196607-98a1-4171-a68b-a9fa7d18480f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114efaa3-b402-4be6-ae93-e156902e0bbb', 'volume_name': 'volume-114efaa3-b402-4be6-ae93-e156902e0bbb', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8e7b49-721a-46e6-97ac-312710ed556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8e7b49-721a-46e6-97ac-312710ed556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e163653-f405-4465-a6d9-bd572462437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:37 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Volume 114efaa3-b402-4be6-ae93-e156902e0bbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114efaa3-b402-4be6-ae93-e156902e0bbb', 'volume_size': 1} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:37 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31" returned: 0 in 0.367s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.093s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1316639511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ffdaa2-16de-4b04-a122-16674b0f2b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2321249f8ab141f4ad554c8cade9eb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:36Z,use_quota=True,user_id='fe0f8bd2fff04ae4b334b4e3eb1b3fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Creating volume 56ffdaa2-16de-4b04-a122-16674b0f2b01 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:37 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-56ffdaa2-16de-4b04-a122-16674b0f2b01 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ea6c5b-d818-4a36-bb13-2f98b4000d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165b1a3a-162a-4189-9522-bdeecfddfe31', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72dcebc-f56a-4df8-a812-220f7e387c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:37 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-56ffdaa2-16de-4b04-a122-16674b0f2b01 1073741824 Jul 31 11:08:37 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:37 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume volume-165b1a3a-162a-4189-9522-bdeecfddfe31 (165b1a3a-162a-4189-9522-bdeecfddfe31): created successfully Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72dcebc-f56a-4df8-a812-220f7e387c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Flow 'volume_create_manager' (acadb0fc-2c5b-4a6f-aa7a-636766531ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:37 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-35b659ba-75ce-48b1-8c14-4e7545a20e39 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created volume successfully. Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Flow 'volume_create_manager' (1ff34df6-8315-43c9-8722-2919de038ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d955fd-7401-4c7e-ba8e-515528ad3ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d955fd-7401-4c7e-ba8e-515528ad3ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1719273995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab72175-76f4-4ab1-b0e0-8ffd71a85eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2321249f8ab141f4ad554c8cade9eb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:37Z,use_quota=True,user_id='fe0f8bd2fff04ae4b334b4e3eb1b3fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e018713a-0782-4f24-83c6-581bac91552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e018713a-0782-4f24-83c6-581bac91552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4dcfed-cfdd-4f31-90e1-e680c8250906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4dcfed-cfdd-4f31-90e1-e680c8250906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ab72175-76f4-4ab1-b0e0-8ffd71a85eec', 'volume_name': 'volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0fc107f-d65a-4804-ac07-6fbcce89a48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0fc107f-d65a-4804-ac07-6fbcce89a48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84fd897-f144-4ff6-b899-59a4394ec5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:37 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Volume 7ab72175-76f4-4ab1-b0e0-8ffd71a85eec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec', 'volume_size': 1} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:37 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-56ffdaa2-16de-4b04-a122-16674b0f2b01 1073741824" returned: 0 in 0.757s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-56ffdaa2-16de-4b04-a122-16674b0f2b01 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:37 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-56ffdaa2-16de-4b04-a122-16674b0f2b01 Jul 31 11:08:37 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Flow 'volume_create_manager' (dc00c2d1-056e-41c3-bc36-1c0ee450c0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00c61fa-542a-4402-b94f-3b3ae9911276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00c61fa-542a-4402-b94f-3b3ae9911276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-274904749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54642503-a2be-4326-858a-9cdb19e5c274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2321249f8ab141f4ad554c8cade9eb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:38Z,use_quota=True,user_id='fe0f8bd2fff04ae4b334b4e3eb1b3fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab2e428-8294-4fd0-8fc4-29ef44f8ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab2e428-8294-4fd0-8fc4-29ef44f8ed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2daa7c9e-75d2-4ad3-b1c0-a532e26a4b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2daa7c9e-75d2-4ad3-b1c0-a532e26a4b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54642503-a2be-4326-858a-9cdb19e5c274', 'volume_name': 'volume-54642503-a2be-4326-858a-9cdb19e5c274', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ca4d28-18e0-420b-88a1-009479cac629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ca4d28-18e0-420b-88a1-009479cac629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0c5d4c-ac02-4545-9993-7ab7fbdbc7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:38 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Volume 54642503-a2be-4326-858a-9cdb19e5c274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54642503-a2be-4326-858a-9cdb19e5c274', 'volume_size': 1} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:38 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-56ffdaa2-16de-4b04-a122-16674b0f2b01" returned: 0 in 0.302s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.856s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1350797086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2321249f8ab141f4ad554c8cade9eb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:36Z,use_quota=True,user_id='fe0f8bd2fff04ae4b334b4e3eb1b3fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Creating volume 3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:38 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068906df-1471-493c-ac92-e59c6c199dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ffdaa2-16de-4b04-a122-16674b0f2b01', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2dd710c-d210-4151-bc20-bf909bb9b74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:38 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4 1073741824 Jul 31 11:08:38 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:38 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Volume volume-56ffdaa2-16de-4b04-a122-16674b0f2b01 (56ffdaa2-16de-4b04-a122-16674b0f2b01): created successfully Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2dd710c-d210-4151-bc20-bf909bb9b74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Flow 'volume_create_manager' (1b93d5d1-4183-4b4d-a24c-8cfeb6fe6c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-50474beb-3fe0-4729-adba-25d6208f70ff tempest-CreateVolumesFromImageTest-1242503324 None] Created volume successfully. Jul 31 11:08:38 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4 1073741824" returned: 0 in 0.442s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:38 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4 Jul 31 11:08:38 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:38 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4" returned: 0 in 0.257s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.303s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039781175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086d3279-cdcc-4a8e-b876-fff34b0fa99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3656530330f14ebabffe305829f522ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:36Z,use_quota=True,user_id='72fd95dcc6a04db9bc1df6e0a8a3a95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Creating volume 086d3279-cdcc-4a8e-b876-fff34b0fa99c {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:38 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03911d0-bd15-4c49-aba3-8f4c8025f414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:38 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c 1073741824 Jul 31 11:08:38 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:38 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b7edc4-38bf-4a93-8843-89d4fcaac75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:39 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Volume volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4 (3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4): created successfully Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b7edc4-38bf-4a93-8843-89d4fcaac75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Flow 'volume_create_manager' (855651fb-cff1-4e0a-bb6f-2f2093db5805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-b6037446-af44-445d-8fbe-2bc7b4179ef9 tempest-CreateVolumesFromImageTest-1242503324 None] Created volume successfully. Jul 31 11:08:39 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c 1073741824" returned: 0 in 0.420s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:39 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c Jul 31 11:08:39 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:39 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c" returned: 0 in 0.256s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.683s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1848476640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114efaa3-b402-4be6-ae93-e156902e0bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2321249f8ab141f4ad554c8cade9eb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:37Z,use_quota=True,user_id='fe0f8bd2fff04ae4b334b4e3eb1b3fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Creating volume 114efaa3-b402-4be6-ae93-e156902e0bbb {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:39 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-114efaa3-b402-4be6-ae93-e156902e0bbb 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:39 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-114efaa3-b402-4be6-ae93-e156902e0bbb 1073741824 Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef73c2be-f047-453f-a807-16fa35556bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:39 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0745bdd-3eaa-419e-b0b3-52b65c35eba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:39 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c (086d3279-cdcc-4a8e-b876-fff34b0fa99c): created successfully Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0745bdd-3eaa-419e-b0b3-52b65c35eba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Flow 'volume_create_manager' (bf863a1f-7d8a-4909-aa1f-b30a7453a505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2ec3b22e-fa35-442f-9b69-8f27a501975e tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Created volume successfully. Jul 31 11:08:40 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-114efaa3-b402-4be6-ae93-e156902e0bbb 1073741824" returned: 0 in 0.485s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Flow 'volume_create_manager' (f2fb7f78-c389-4b61-abff-3457837f8267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81691c8a-0b78-4e2e-8b5b-bc0862f011aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81691c8a-0b78-4e2e-8b5b-bc0862f011aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee991f0-7030-4cd7-b41c-bcc2205f85f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c171d9b80a5461fa0d6092226b04fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:40Z,use_quota=True,user_id='c8bd6f0bb81f4b928ac3f528e08e3921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3ddf8ca-f6d3-4b7d-8203-4f972109086b),volume_type_id=a3ddf8ca-f6d3-4b7d-8203-4f972109086b)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd22ad5-3770-41ab-9e75-6a534c3bdc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd22ad5-3770-41ab-9e75-6a534c3bdc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889f838d-a019-455b-b7eb-adbe6cf508f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.image.glance [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Creating Keystone auth plugin from conf {{(pid=89145) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-114efaa3-b402-4be6-ae93-e156902e0bbb {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:40 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-114efaa3-b402-4be6-ae93-e156902e0bbb Jul 31 11:08:40 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889f838d-a019-455b-b7eb-adbe6cf508f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ee991f0-7030-4cd7-b41c-bcc2205f85f7', 'volume_name': 'volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7', 'volume_size': 1, 'image_id': '809772e9-4d17-4037-b35e-e6996d5ad37c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/809772e9-4d17-4037-b35e-e6996d5ad37c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e87dd1abc6a9c153f587fa580e5efcbd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c171d9b80a5461fa0d6092226b04fcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63f1f89cfe8449ed62980a318868afada480c96d3bf0d48faa89ba9f86deaec38e643ab9b3eb8a0f21a48744d36db145c906dff48308ff266024a50282fc7bcb', 'id': '809772e9-4d17-4037-b35e-e6996d5ad37c', 'created_at': datetime.datetime(2026, 7, 31, 9, 8, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 8, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/809772e9-4d17-4037-b35e-e6996d5ad37c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c0738c-b6d4-45e1-9cc4-d97d4d265b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c0738c-b6d4-45e1-9cc4-d97d4d265b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:40 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafa3cd1-58c6-42bf-875b-6bcebc3f8a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:40 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Volume 1ee991f0-7030-4cd7-b41c-bcc2205f85f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7', 'volume_size': 1, 'image_id': '809772e9-4d17-4037-b35e-e6996d5ad37c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/809772e9-4d17-4037-b35e-e6996d5ad37c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e87dd1abc6a9c153f587fa580e5efcbd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c171d9b80a5461fa0d6092226b04fcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63f1f89cfe8449ed62980a318868afada480c96d3bf0d48faa89ba9f86deaec38e643ab9b3eb8a0f21a48744d36db145c906dff48308ff266024a50282fc7bcb', 'id': '809772e9-4d17-4037-b35e-e6996d5ad37c', 'created_at': datetime.datetime(2026, 7, 31, 9, 8, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 8, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/809772e9-4d17-4037-b35e-e6996d5ad37c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Trying to clone 1ee991f0-7030-4cd7-b41c-bcc2205f85f7 from image 809772e9-4d17-4037-b35e-e6996d5ad37c at location (None, [{'url': 'file:///opt/stack/data/glance/images/809772e9-4d17-4037-b35e-e6996d5ad37c', 'metadata': {}}]). {{(pid=89145) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-114efaa3-b402-4be6-ae93-e156902e0bbb" returned: 0 in 0.271s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.061s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1719273995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab72175-76f4-4ab1-b0e0-8ffd71a85eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2321249f8ab141f4ad554c8cade9eb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:37Z,use_quota=True,user_id='fe0f8bd2fff04ae4b334b4e3eb1b3fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Creating volume 7ab72175-76f4-4ab1-b0e0-8ffd71a85eec {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:40 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:40 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec 1073741824 Jul 31 11:08:40 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e163653-f405-4465-a6d9-bd572462437d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114efaa3-b402-4be6-ae93-e156902e0bbb', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc76c850-a21d-43b0-a80b-5474b1efec18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:40 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Volume volume-114efaa3-b402-4be6-ae93-e156902e0bbb (114efaa3-b402-4be6-ae93-e156902e0bbb): created successfully Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc76c850-a21d-43b0-a80b-5474b1efec18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Flow 'volume_create_manager' (b742ef82-8497-4cc3-8a7b-f4697daf24cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:40 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-df187e90-29aa-4460-b08d-ee332dfefa57 tempest-CreateVolumesFromImageTest-1242503324 None] Created volume successfully. Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:08:40 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Image download 0.00 MB at 0.00 MB/s Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ed28be-8c53-4c6a-bab5-a3660dace4d3]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:40 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD Jul 31 11:08:40 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:41 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec 1073741824" returned: 0 in 0.543s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:41 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:41 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec Jul 31 11:08:41 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:41 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:41 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Flow 'volume_create_manager' (76644317-c3dd-4078-995b-1215570d0563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcdf8bd-db4d-46c0-a186-e6a31c5f48ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcdf8bd-db4d-46c0-a186-e6a31c5f48ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009737697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177ae226-35bf-4937-a1be-de4db079465e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3656530330f14ebabffe305829f522ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:41Z,use_quota=True,user_id='72fd95dcc6a04db9bc1df6e0a8a3a95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5cdbfe-2a3e-4845-aa96-9d626fe122d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5cdbfe-2a3e-4845-aa96-9d626fe122d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1206de9-e26d-4d68-b4ad-d8c6b669cbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1206de9-e26d-4d68-b4ad-d8c6b669cbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '177ae226-35bf-4937-a1be-de4db079465e', 'volume_name': 'volume-177ae226-35bf-4937-a1be-de4db079465e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb4557a-ed2c-41cd-9893-fad278a7f8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb4557a-ed2c-41cd-9893-fad278a7f8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a0660e-3097-4ccf-b388-bf99d6f10843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:41 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume 177ae226-35bf-4937-a1be-de4db079465e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-177ae226-35bf-4937-a1be-de4db079465e', 'volume_size': 1} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:41 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Temporary image 809772e9-4d17-4037-b35e-e6996d5ad37c is fetched for user c8bd6f0bb81f4b928ac3f528e08e3921. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:08:41 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec" returned: 0 in 0.346s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.488s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-274904749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54642503-a2be-4326-858a-9cdb19e5c274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2321249f8ab141f4ad554c8cade9eb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:38Z,use_quota=True,user_id='fe0f8bd2fff04ae4b334b4e3eb1b3fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Creating volume 54642503-a2be-4326-858a-9cdb19e5c274 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:41 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-54642503-a2be-4326-858a-9cdb19e5c274 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84fd897-f144-4ff6-b899-59a4394ec5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:41 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-54642503-a2be-4326-858a-9cdb19e5c274 1073741824 Jul 31 11:08:41 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ac7098-72c0-4037-b5d0-2551f4d00bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:41 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Volume volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec (7ab72175-76f4-4ab1-b0e0-8ffd71a85eec): created successfully Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ac7098-72c0-4037-b5d0-2551f4d00bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Flow 'volume_create_manager' (1ff34df6-8315-43c9-8722-2919de038ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:41 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e72dc9ca-cece-4b47-95bf-a7e8be0b1a32 tempest-CreateVolumesFromImageTest-1242503324 None] Created volume successfully. Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9a1a88-72d8-4d00-b59f-7a3510721e74]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Flow 'volume_create_manager' (a8ea9120-9dd5-443e-a097-d10d93f10028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4405b51d-d86b-447c-a431-e74320683ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:41 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD Jul 31 11:08:41 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4405b51d-d86b-447c-a431-e74320683ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-996556194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=822ac8b7-29d0-49b4-b5cb-7c19c0dffab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3656530330f14ebabffe305829f522ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:42Z,use_quota=True,user_id='72fd95dcc6a04db9bc1df6e0a8a3a95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81675669-48e8-4be9-b0cc-d1f2e835588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81675669-48e8-4be9-b0cc-d1f2e835588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0782b9-bef0-4762-8db8-4691b56f005e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0782b9-bef0-4762-8db8-4691b56f005e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '822ac8b7-29d0-49b4-b5cb-7c19c0dffab3', 'volume_name': 'volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc733aa-207d-4053-a079-0598ea59a380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc733aa-207d-4053-a079-0598ea59a380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c87147d-c0fa-4a29-9c37-c695ac1f1d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:41 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume 822ac8b7-29d0-49b4-b5cb-7c19c0dffab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3', 'volume_size': 1} Jul 31 11:08:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:42 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Flow 'volume_create_manager' (4530ddfb-77b8-4299-a9ca-cb534ea4ef8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac26d88-be6a-4914-9d30-cf10d00c79c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:42 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-54642503-a2be-4326-858a-9cdb19e5c274 1073741824" returned: 0 in 0.602s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac26d88-be6a-4914-9d30-cf10d00c79c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029076857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07e67ac-b53e-4ec9-b1e2-1f593ff65e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3656530330f14ebabffe305829f522ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:42Z,use_quota=True,user_id='72fd95dcc6a04db9bc1df6e0a8a3a95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0e7522-1228-4305-b5dd-303595b5dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0e7522-1228-4305-b5dd-303595b5dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d317e680-ebff-4f01-b150-5ee2067f3b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d317e680-ebff-4f01-b150-5ee2067f3b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd07e67ac-b53e-4ec9-b1e2-1f593ff65e47', 'volume_name': 'volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e774823a-a53b-42a1-a7f5-666a5a8a4050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e774823a-a53b-42a1-a7f5-666a5a8a4050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fd0135-0e08-42cd-8d61-7bf6de32571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:42 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume d07e67ac-b53e-4ec9-b1e2-1f593ff65e47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47', 'volume_size': 1} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-54642503-a2be-4326-858a-9cdb19e5c274 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:42 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-54642503-a2be-4326-858a-9cdb19e5c274 Jul 31 11:08:42 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:42 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD Jul 31 11:08:42 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:42 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD" returned: 1 in 0.456s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:42 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-54642503-a2be-4326-858a-9cdb19e5c274" returned: 0 in 0.372s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.559s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0c5d4c-ac02-4545-9993-7ab7fbdbc7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54642503-a2be-4326-858a-9cdb19e5c274', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2ea50b-fa78-40af-a497-8d6833de0693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Creating offline snapshot d5332cbc-2528-4eec-9a27-b67998d0a45c of volume 165b1a3a-162a-4189-9522-bdeecfddfe31 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:08:42 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Volume volume-54642503-a2be-4326-858a-9cdb19e5c274 (54642503-a2be-4326-858a-9cdb19e5c274): created successfully Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2ea50b-fa78-40af-a497-8d6833de0693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Flow 'volume_create_manager' (dc00c2d1-056e-41c3-bc36-1c0ee450c0da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d15887f-0a92-4352-96f7-ecf82c22286e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c94570bb-529f-4436-8ef1-f021e1672ce2 tempest-CreateVolumesFromImageTest-1242503324 None] Created volume successfully. Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Flow 'volume_create_manager' (ca685e50-ca12-45b9-bfea-684e2c6c01b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0145a4a0-4cf8-47cd-8904-d7c5ad6f2b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0145a4a0-4cf8-47cd-8904-d7c5ad6f2b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-608675386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a62896-4495-4188-aec0-f7a6750b89ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3656530330f14ebabffe305829f522ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:43Z,use_quota=True,user_id='72fd95dcc6a04db9bc1df6e0a8a3a95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2612b0f8-b59a-4a97-85da-36200efcbb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2612b0f8-b59a-4a97-85da-36200efcbb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff60f0b-f1cc-4879-9209-334a571753b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff60f0b-f1cc-4879-9209-334a571753b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a62896-4495-4188-aec0-f7a6750b89ac', 'volume_name': 'volume-31a62896-4495-4188-aec0-f7a6750b89ac', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28dc7450-d47e-4dd8-99f1-d0da820351c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28dc7450-d47e-4dd8-99f1-d0da820351c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9153f20b-0f05-4051-b500-85f77a355512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:42 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume 31a62896-4495-4188-aec0-f7a6750b89ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a62896-4495-4188-aec0-f7a6750b89ac', 'volume_size': 1} Jul 31 11:08:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:42 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 Jul 31 11:08:42 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Flow 'volume_create_manager' (97c3b379-c240-4012-852f-01c96165562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efe97d9-e433-4340-b183-65f75f9896f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efe97d9-e433-4340-b183-65f75f9896f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-404783347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18188349-f59f-4615-b6b8-7f447afa86aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3656530330f14ebabffe305829f522ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:43Z,use_quota=True,user_id='72fd95dcc6a04db9bc1df6e0a8a3a95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c7369e-c7fc-4f15-ae27-5ab12eca9754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c7369e-c7fc-4f15-ae27-5ab12eca9754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98469e95-f389-40be-be47-8c9f6df21643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:43 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98469e95-f389-40be-be47-8c9f6df21643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18188349-f59f-4615-b6b8-7f447afa86aa', 'volume_name': 'volume-18188349-f59f-4615-b6b8-7f447afa86aa', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77865e58-947e-42a4-902c-51f8b04b2a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77865e58-947e-42a4-902c-51f8b04b2a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2e9189-a82f-4c1a-ae9c-bdfef82ecf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:43 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume 18188349-f59f-4615-b6b8-7f447afa86aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18188349-f59f-4615-b6b8-7f447afa86aa', 'volume_size': 1} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31" returned: 0 in 0.423s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:43 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c 1G Jul 31 11:08:43 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:43 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c 1G" returned: 0 in 0.425s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165b1a3a-162a-4189-9522-bdeecfddfe31 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "cinder-54642503-a2be-4326-858a-9cdb19e5c274-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:43 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165b1a3a-162a-4189-9522-bdeecfddfe31 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c Jul 31 11:08:43 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-54642503-a2be-4326-858a-9cdb19e5c274-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "cinder-quobyte-54642503-a2be-4326-858a-9cdb19e5c274" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-quobyte-54642503-a2be-4326-858a-9cdb19e5c274" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[d085cc81-44cb-4d32-a0b3-7d33667cfc1f]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-54642503-a2be-4326-858a-9cdb19e5c274 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:43 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-54642503-a2be-4326-858a-9cdb19e5c274 Jul 31 11:08:43 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:43 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165b1a3a-162a-4189-9522-bdeecfddfe31 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c" returned: 0 in 0.314s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:43 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c is being set with open permissions: ugo+rw Jul 31 11:08:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:43 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c Jul 31 11:08:43 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:44 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-54642503-a2be-4326-858a-9cdb19e5c274" returned: 0 in 0.385s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-54642503-a2be-4326-858a-9cdb19e5c274 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:44 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-54642503-a2be-4326-858a-9cdb19e5c274 Jul 31 11:08:44 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:44 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c" returned: 0 in 0.253s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:44 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.info Jul 31 11:08:44 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:44 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-54642503-a2be-4326-858a-9cdb19e5c274" returned: 0 in 0.274s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-quobyte-54642503-a2be-4326-858a-9cdb19e5c274" released by "delete_volume" :: held 0.706s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Created reservations ['08516f73-ec0a-47d7-a91e-aee9b07d897e', '177fd531-b803-41ca-b428-2dc87ec59a99', 'f879dc5d-c800-4df2-8aa2-fc5923946ded', 'aa14b6f1-f4bd-4cf4-b2ab-5eb89bba201f'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:44 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.info" returned: 0 in 0.302s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:44 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.info is being set with open permissions: ugo+rw Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:44 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.info Jul 31 11:08:44 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:44 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:44 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:44 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "cinder-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.info" returned: 0 in 0.294s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:44 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.435s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009737697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177ae226-35bf-4937-a1be-de4db079465e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3656530330f14ebabffe305829f522ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:41Z,use_quota=True,user_id='72fd95dcc6a04db9bc1df6e0a8a3a95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Creating volume 177ae226-35bf-4937-a1be-de4db079465e {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:44 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-177ae226-35bf-4937-a1be-de4db079465e 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.311s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:44 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-177ae226-35bf-4937-a1be-de4db079465e 1073741824 Jul 31 11:08:44 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:44 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Deleted volume successfully. Jul 31 11:08:44 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-0888b5cd-6162-4afe-93b0-7d3772098904 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Create snapshot completed successfully Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0faa632e-e713-4f0d-bd4d-6e205791b82f tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-54642503-a2be-4326-858a-9cdb19e5c274-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "cinder-quobyte-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-quobyte-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec" acquired by "delete_volume" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bed8ab-4e52-4808-8acc-3bbfb16ee234]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:45 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec Jul 31 11:08:45 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:45 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-177ae226-35bf-4937-a1be-de4db079465e 1073741824" returned: 0 in 0.467s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-177ae226-35bf-4937-a1be-de4db079465e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:45 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec" returned: 0 in 0.380s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:45 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-177ae226-35bf-4937-a1be-de4db079465e Jul 31 11:08:45 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:45 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec Jul 31 11:08:45 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:45 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-177ae226-35bf-4937-a1be-de4db079465e" returned: 0 in 0.290s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:45 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.754s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-996556194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=822ac8b7-29d0-49b4-b5cb-7c19c0dffab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3656530330f14ebabffe305829f522ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:42Z,use_quota=True,user_id='72fd95dcc6a04db9bc1df6e0a8a3a95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Creating volume 822ac8b7-29d0-49b4-b5cb-7c19c0dffab3 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:45 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec" returned: 0 in 0.314s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:45 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3 1073741824 Jul 31 11:08:45 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a0660e-3097-4ccf-b388-bf99d6f10843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177ae226-35bf-4937-a1be-de4db079465e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2042cd5-1325-40e1-be67-59d44e5c22d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-quobyte-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec" released by "delete_volume" :: held 0.770s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:45 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume volume-177ae226-35bf-4937-a1be-de4db079465e (177ae226-35bf-4937-a1be-de4db079465e): created successfully Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2042cd5-1325-40e1-be67-59d44e5c22d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Flow 'volume_create_manager' (76644317-c3dd-4078-995b-1215570d0563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1f0ee845-4888-4ab6-8db3-bbee8596cd36 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Created volume successfully. Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Created reservations ['e5dd4a3d-a0c4-47c1-8341-80dd8351bcfb', '5d0c6ad5-eea7-44c3-acfe-a632d9afeeca', '7dd28368-1939-4c03-9027-64baa7f15a65', '22aa96d8-22ff-4378-9c1d-5ef46c9924cb'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:45 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:45 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "cinder-114efaa3-b402-4be6-ae93-e156902e0bbb-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Flow 'volume_create_manager' (fee70a2e-508e-4def-8a87-3a92d7eb8d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44db93d-e32b-4d4e-a572-dc5b7d1a8442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-114efaa3-b402-4be6-ae93-e156902e0bbb-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44db93d-e32b-4d4e-a572-dc5b7d1a8442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1917415111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d2427c-2c62-4e91-b679-240a6f04b6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e239d1e7d98b4d858e8b4358f7983631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:46Z,use_quota=True,user_id='d32cdce3051249cb9630cdf16dc09700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6300ed45-99f4-45ad-94ce-ecfe2c9d3155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6300ed45-99f4-45ad-94ce-ecfe2c9d3155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102f3d61-8f5e-4357-9f5d-565f1c983f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102f3d61-8f5e-4357-9f5d-565f1c983f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d2427c-2c62-4e91-b679-240a6f04b6e3', 'volume_name': 'volume-17d2427c-2c62-4e91-b679-240a6f04b6e3', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fb78f1-f13f-46c4-99d6-f599aa99b7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fb78f1-f13f-46c4-99d6-f599aa99b7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e5a431-0b35-469a-a7fd-1a4849816192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:46 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume 17d2427c-2c62-4e91-b679-240a6f04b6e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d2427c-2c62-4e91-b679-240a6f04b6e3', 'volume_size': 1} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "cinder-quobyte-114efaa3-b402-4be6-ae93-e156902e0bbb" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-quobyte-114efaa3-b402-4be6-ae93-e156902e0bbb" acquired by "delete_volume" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec157b87-bca6-4470-8ce8-d66ba41154eb]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-114efaa3-b402-4be6-ae93-e156902e0bbb {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:46 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.402s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:46 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Deleted volume successfully. Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-dcc57206-3794-492d-89a2-04e0ee94c02d tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-7ab72175-76f4-4ab1-b0e0-8ffd71a85eec-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:46 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3 1073741824" returned: 0 in 0.736s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:46 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-114efaa3-b402-4be6-ae93-e156902e0bbb Jul 31 11:08:46 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:46 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3 Jul 31 11:08:46 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Flow 'volume_create_manager' (c7861099-028a-49ec-88f4-8ebc7d404c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f914ac-af9f-495a-9864-1c5730b0b829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f914ac-af9f-495a-9864-1c5730b0b829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-353372143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce09792-b279-433d-ac6a-d7e083445ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e239d1e7d98b4d858e8b4358f7983631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:46Z,use_quota=True,user_id='d32cdce3051249cb9630cdf16dc09700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cb93af-48b1-4c41-a90e-5a078ea99e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cb93af-48b1-4c41-a90e-5a078ea99e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326c0c1f-2c5b-4cfe-bfc7-96f969dad783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326c0c1f-2c5b-4cfe-bfc7-96f969dad783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce09792-b279-433d-ac6a-d7e083445ca2', 'volume_name': 'volume-1ce09792-b279-433d-ac6a-d7e083445ca2', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c4d2a7-1f95-41c4-adca-fa3111a930e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c4d2a7-1f95-41c4-adca-fa3111a930e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a0e820-4b86-4a88-9708-7baedb791fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:46 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume 1ce09792-b279-433d-ac6a-d7e083445ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce09792-b279-433d-ac6a-d7e083445ca2', 'volume_size': 1} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:46 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-114efaa3-b402-4be6-ae93-e156902e0bbb" returned: 0 in 0.485s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-114efaa3-b402-4be6-ae93-e156902e0bbb {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:46 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3" returned: 0 in 0.338s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.531s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029076857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07e67ac-b53e-4ec9-b1e2-1f593ff65e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3656530330f14ebabffe305829f522ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:42Z,use_quota=True,user_id='72fd95dcc6a04db9bc1df6e0a8a3a95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Creating volume d07e67ac-b53e-4ec9-b1e2-1f593ff65e47 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:46 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-114efaa3-b402-4be6-ae93-e156902e0bbb Jul 31 11:08:46 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:46 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c87147d-c0fa-4a29-9c37-c695ac1f1d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:46 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47 1073741824 Jul 31 11:08:46 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada5749c-392e-434a-90b6-3661a321087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:46 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3 (822ac8b7-29d0-49b4-b5cb-7c19c0dffab3): created successfully Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada5749c-392e-434a-90b6-3661a321087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Flow 'volume_create_manager' (a8ea9120-9dd5-443e-a097-d10d93f10028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:46 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-eb42f1df-d7c7-44a4-ad80-a49ad4b596ab tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Created volume successfully. Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Flow 'volume_create_manager' (7b2d6c80-6a3d-4f19-a057-e5fff58def0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999b638f-25a9-4f7b-a876-2b5abf0b943c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:47 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-114efaa3-b402-4be6-ae93-e156902e0bbb" returned: 0 in 0.312s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999b638f-25a9-4f7b-a876-2b5abf0b943c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349125487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a9eaa92-e126-4728-b533-40c916a2c3eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e239d1e7d98b4d858e8b4358f7983631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:47Z,use_quota=True,user_id='d32cdce3051249cb9630cdf16dc09700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596bc2db-8804-4eca-bd8d-8c271727564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596bc2db-8804-4eca-bd8d-8c271727564f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbde9a90-e427-4ec8-88cc-2569cda9419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbde9a90-e427-4ec8-88cc-2569cda9419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a9eaa92-e126-4728-b533-40c916a2c3eb', 'volume_name': 'volume-3a9eaa92-e126-4728-b533-40c916a2c3eb', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0861bc75-aacc-4ee9-8faa-714541a41fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0861bc75-aacc-4ee9-8faa-714541a41fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19495fb4-9f29-4d4b-84f3-03e7ffd7ec75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:47 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume 3a9eaa92-e126-4728-b533-40c916a2c3eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a9eaa92-e126-4728-b533-40c916a2c3eb', 'volume_size': 1} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-quobyte-114efaa3-b402-4be6-ae93-e156902e0bbb" released by "delete_volume" :: held 0.939s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Created reservations ['f18b5e21-9e18-4e8b-87be-e6494ae97b81', 'e3cfa183-ba51-4156-af74-6c5863166446', '2af2798a-446e-4acb-a30c-8bcd38cc8327', '38344570-0418-4657-95e6-1f9840b0d62a'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:47 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:47 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:47 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47 1073741824" returned: 0 in 0.719s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Flow 'volume_create_manager' (a9483f3e-73a9-4afe-81da-652e3ac46df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea99cb5-f703-43db-ba88-8dce678dc680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea99cb5-f703-43db-ba88-8dce678dc680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408141650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ba1840-69c0-411f-8952-efe2354702c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e239d1e7d98b4d858e8b4358f7983631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:47Z,use_quota=True,user_id='d32cdce3051249cb9630cdf16dc09700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb60b98-de00-4319-bb37-e2c9566ad6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb60b98-de00-4319-bb37-e2c9566ad6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b31847-34f2-46d5-aff7-1dcceba8987b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b31847-34f2-46d5-aff7-1dcceba8987b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ba1840-69c0-411f-8952-efe2354702c0', 'volume_name': 'volume-a0ba1840-69c0-411f-8952-efe2354702c0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0cb8dc-6cec-4eb3-80b1-d94e1775f116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0cb8dc-6cec-4eb3-80b1-d94e1775f116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5488a5e-87b7-4411-9337-39c193f38005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:47 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume a0ba1840-69c0-411f-8952-efe2354702c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ba1840-69c0-411f-8952-efe2354702c0', 'volume_size': 1} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:47 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47 Jul 31 11:08:47 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:47 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.285s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:47 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Deleted volume successfully. Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-31c99d3a-aab2-4297-91e0-bb5b8931978a tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-114efaa3-b402-4be6-ae93-e156902e0bbb-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:47 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Flow 'volume_create_manager' (fa8eeb54-564e-411a-a2f8-76407f81d3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b71ab0-b993-4b61-a6ed-baabcad35fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47" returned: 0 in 0.327s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.376s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee991f0-7030-4cd7-b41c-bcc2205f85f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c171d9b80a5461fa0d6092226b04fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:40Z,use_quota=True,user_id='c8bd6f0bb81f4b928ac3f528e08e3921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3ddf8ca-f6d3-4b7d-8203-4f972109086b),volume_type_id=a3ddf8ca-f6d3-4b7d-8203-4f972109086b)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Creating volume 1ee991f0-7030-4cd7-b41c-bcc2205f85f7 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:48 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fd0135-0e08-42cd-8d61-7bf6de32571f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90e08f8-cbea-4065-b468-be314714bf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:48 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 1073741824 Jul 31 11:08:48 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b71ab0-b993-4b61-a6ed-baabcad35fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-290978458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b797897e-86b3-486b-9570-24ee438a4b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e239d1e7d98b4d858e8b4358f7983631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:48Z,use_quota=True,user_id='d32cdce3051249cb9630cdf16dc09700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13aac10-ce3e-4beb-b256-b352c49d02ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13aac10-ce3e-4beb-b256-b352c49d02ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6703a9c6-ae9a-4eaa-88fa-759dba7d7bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6703a9c6-ae9a-4eaa-88fa-759dba7d7bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b797897e-86b3-486b-9570-24ee438a4b5f', 'volume_name': 'volume-b797897e-86b3-486b-9570-24ee438a4b5f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba367be-27ec-445e-a9e1-56d3e9d538f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba367be-27ec-445e-a9e1-56d3e9d538f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07261b1-d873-4cda-9730-7f41df510afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:48 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume b797897e-86b3-486b-9570-24ee438a4b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b797897e-86b3-486b-9570-24ee438a4b5f', 'volume_size': 1} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:48 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47 (d07e67ac-b53e-4ec9-b1e2-1f593ff65e47): created successfully Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90e08f8-cbea-4065-b468-be314714bf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Flow 'volume_create_manager' (4530ddfb-77b8-4299-a9ca-cb534ea4ef8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:48 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-24c8bac0-030e-4e6c-ad54-2ea42e919fc1 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Created volume successfully. Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "cinder-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "cinder-quobyte-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-quobyte-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2d8cf9-8273-4d90-b41d-caaf925b197d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:48 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 1073741824" returned: 0 in 0.463s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:48 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4 Jul 31 11:08:48 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:48 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 Jul 31 11:08:48 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:48 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:48 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7" returned: 0 in 0.278s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.921s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-608675386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a62896-4495-4188-aec0-f7a6750b89ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3656530330f14ebabffe305829f522ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:43Z,use_quota=True,user_id='72fd95dcc6a04db9bc1df6e0a8a3a95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Creating volume 31a62896-4495-4188-aec0-f7a6750b89ac {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:48 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-31a62896-4495-4188-aec0-f7a6750b89ac 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4" returned: 0 in 0.419s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:48 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-31a62896-4495-4188-aec0-f7a6750b89ac 1073741824 Jul 31 11:08:48 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:48 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4 Jul 31 11:08:48 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Attempting download of 809772e9-4d17-4037-b35e-e6996d5ad37c ((None, [{'url': 'file:///opt/stack/data/glance/images/809772e9-4d17-4037-b35e-e6996d5ad37c', 'metadata': {}}])) to volume 1ee991f0-7030-4cd7-b41c-bcc2205f85f7. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c67bb7-312e-446d-9fe0-dc16fb1a8fab]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_809772e9-4d17-4037-b35e-e6996d5ad37c_1ugr6oej {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:49 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_809772e9-4d17-4037-b35e-e6996d5ad37c_1ugr6oej Jul 31 11:08:49 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:49 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4" returned: 0 in 0.274s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-quobyte-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4" released by "delete_volume" :: held 0.735s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Created reservations ['c5d9eb18-62d2-416c-bac6-56d5ad4a3ad2', 'c11ff5b1-2743-4fc6-ba8c-0f9744315cac', 'f61f1da5-7590-4b30-80a3-f9e6afe5bba3', 'e988c4c5-2f9c-4d71-b544-e296cb8e508d'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:49 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-31a62896-4495-4188-aec0-f7a6750b89ac 1073741824" returned: 0 in 0.436s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:49 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_809772e9-4d17-4037-b35e-e6996d5ad37c_1ugr6oej" returned: 0 in 0.364s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:49 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:49 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_809772e9-4d17-4037-b35e-e6996d5ad37c_1ugr6oej {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-31a62896-4495-4188-aec0-f7a6750b89ac {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:49 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-31a62896-4495-4188-aec0-f7a6750b89ac Jul 31 11:08:49 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:49 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_809772e9-4d17-4037-b35e-e6996d5ad37c_1ugr6oej Jul 31 11:08:49 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "cinder-56ffdaa2-16de-4b04-a122-16674b0f2b01-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-56ffdaa2-16de-4b04-a122-16674b0f2b01-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:49 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "cinder-quobyte-56ffdaa2-16de-4b04-a122-16674b0f2b01" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-31a62896-4495-4188-aec0-f7a6750b89ac" returned: 0 in 0.328s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.500s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-404783347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18188349-f59f-4615-b6b8-7f447afa86aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3656530330f14ebabffe305829f522ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:43Z,use_quota=True,user_id='72fd95dcc6a04db9bc1df6e0a8a3a95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Creating volume 18188349-f59f-4615-b6b8-7f447afa86aa {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:49 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18188349-f59f-4615-b6b8-7f447afa86aa 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:49 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.421s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-quobyte-56ffdaa2-16de-4b04-a122-16674b0f2b01" acquired by "delete_volume" :: waited 0.083s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:49 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18188349-f59f-4615-b6b8-7f447afa86aa 1073741824 Jul 31 11:08:49 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9153f20b-0f05-4051-b500-85f77a355512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a62896-4495-4188-aec0-f7a6750b89ac', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3384e445-fb53-408a-8b1e-ed1c3aa78272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:49 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb8a2b6-7c57-405c-9624-7be85978c8b8]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:49 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Deleted volume successfully. Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-56ffdaa2-16de-4b04-a122-16674b0f2b01 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_809772e9-4d17-4037-b35e-e6996d5ad37c_1ugr6oej" returned: 1 in 0.482s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_809772e9-4d17-4037-b35e-e6996d5ad37c_1ugr6oej' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9f300d-6f51-4111-b769-2500850d2c5a]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:49 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume volume-31a62896-4495-4188-aec0-f7a6750b89ac (31a62896-4495-4188-aec0-f7a6750b89ac): created successfully Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3384e445-fb53-408a-8b1e-ed1c3aa78272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Flow 'volume_create_manager' (ca685e50-ca12-45b9-bfea-684e2c6c01b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:49 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-cc4b34ff-0644-4988-b9f9-759bfe401338 tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-3ac471ce-0e16-42c2-a6a1-cb9e7c8c3af4-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:49 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-85ef0283-3eea-49a4-b594-a7a4ca72dd65 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Created volume successfully. Jul 31 11:08:49 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-56ffdaa2-16de-4b04-a122-16674b0f2b01 Jul 31 11:08:49 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:49 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD Jul 31 11:08:49 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:50 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:50 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-56ffdaa2-16de-4b04-a122-16674b0f2b01" returned: 0 in 0.429s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:50 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-56ffdaa2-16de-4b04-a122-16674b0f2b01 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18188349-f59f-4615-b6b8-7f447afa86aa 1073741824" returned: 0 in 0.535s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:50 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-56ffdaa2-16de-4b04-a122-16674b0f2b01 Jul 31 11:08:50 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18188349-f59f-4615-b6b8-7f447afa86aa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:50 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD Jul 31 11:08:50 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:50 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18188349-f59f-4615-b6b8-7f447afa86aa Jul 31 11:08:50 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:50 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-56ffdaa2-16de-4b04-a122-16674b0f2b01" returned: 0 in 0.284s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-quobyte-56ffdaa2-16de-4b04-a122-16674b0f2b01" released by "delete_volume" :: held 0.785s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:50 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18188349-f59f-4615-b6b8-7f447afa86aa" returned: 0 in 0.270s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.352s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1917415111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d2427c-2c62-4e91-b679-240a6f04b6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e239d1e7d98b4d858e8b4358f7983631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:46Z,use_quota=True,user_id='d32cdce3051249cb9630cdf16dc09700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:50 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Creating volume 17d2427c-2c62-4e91-b679-240a6f04b6e3 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:50 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d2427c-2c62-4e91-b679-240a6f04b6e3 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] 809772e9-4d17-4037-b35e-e6996d5ad37c was raw, converting to raw {{(pid=89145) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:08:50 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d2427c-2c62-4e91-b679-240a6f04b6e3 1073741824 Jul 31 11:08:50 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2e9189-a82f-4c1a-ae9c-bdfef82ecf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18188349-f59f-4615-b6b8-7f447afa86aa', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:50 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 Jul 31 11:08:50 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52c315c-2d21-4aa1-ac83-fe5534b01e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:50 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Volume volume-18188349-f59f-4615-b6b8-7f447afa86aa (18188349-f59f-4615-b6b8-7f447afa86aa): created successfully Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52c315c-2d21-4aa1-ac83-fe5534b01e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Flow 'volume_create_manager' (97c3b379-c240-4012-852f-01c96165562c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:50 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-64491fc1-4786-4534-8d16-4463e485aa5c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Created volume successfully. Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Created reservations ['64009f26-0e1a-4c99-ba3c-d50a79310301', '9c0f6cab-6fb0-4efd-ae4c-58d5c1ce0dad', 'fa4d95c8-14a3-4731-9921-f0f449d0fe5d', '0bfad707-af69-481f-a7f8-e7b6257fb03a'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:50 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:50 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "cinder-18188349-f59f-4615-b6b8-7f447afa86aa-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-18188349-f59f-4615-b6b8-7f447afa86aa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:51 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7" returned: 0 in 0.443s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_809772e9-4d17-4037-b35e-e6996d5ad37c_svpcmlovdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:08:51 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:51 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 1G Jul 31 11:08:51 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "cinder-quobyte-18188349-f59f-4615-b6b8-7f447afa86aa" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-quobyte-18188349-f59f-4615-b6b8-7f447afa86aa" acquired by "delete_volume" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f70ee2-531f-4864-aa6d-56193bb55aea]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18188349-f59f-4615-b6b8-7f447afa86aa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:51 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d2427c-2c62-4e91-b679-240a6f04b6e3 1073741824" returned: 0 in 0.619s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:51 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.397s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:51 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Deleted volume successfully. Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d2427c-2c62-4e91-b679-240a6f04b6e3 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9562fd65-6629-4f47-8752-aac20d80d22e tempest-CreateVolumesFromImageTest-1242503324 None] Lock "cinder-56ffdaa2-16de-4b04-a122-16674b0f2b01-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:51 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d2427c-2c62-4e91-b679-240a6f04b6e3 Jul 31 11:08:51 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:51 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18188349-f59f-4615-b6b8-7f447afa86aa Jul 31 11:08:51 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:51 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 1G" returned: 0 in 0.328s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce29540-06d5-434b-8c4d-7eacb51e3bdc]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:51 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d2427c-2c62-4e91-b679-240a6f04b6e3" returned: 0 in 0.283s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.837s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-353372143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce09792-b279-433d-ac6a-d7e083445ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e239d1e7d98b4d858e8b4358f7983631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:46Z,use_quota=True,user_id='d32cdce3051249cb9630cdf16dc09700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Creating volume 1ce09792-b279-433d-ac6a-d7e083445ca2 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:51 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ce09792-b279-433d-ac6a-d7e083445ca2 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:51 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 Jul 31 11:08:51 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:51 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ce09792-b279-433d-ac6a-d7e083445ca2 1073741824 Jul 31 11:08:51 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e5a431-0b35-469a-a7fd-1a4849816192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d2427c-2c62-4e91-b679-240a6f04b6e3', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd30fee-cb66-4c03-a9e7-a00e87567f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:51 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18188349-f59f-4615-b6b8-7f447afa86aa" returned: 0 in 0.435s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18188349-f59f-4615-b6b8-7f447afa86aa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:51 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume volume-17d2427c-2c62-4e91-b679-240a6f04b6e3 (17d2427c-2c62-4e91-b679-240a6f04b6e3): created successfully Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd30fee-cb66-4c03-a9e7-a00e87567f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:51 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18188349-f59f-4615-b6b8-7f447afa86aa Jul 31 11:08:51 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Flow 'volume_create_manager' (fee70a2e-508e-4def-8a87-3a92d7eb8d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:51 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-39a54c2e-dfa8-421b-b6b7-6fc764fe8beb tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created volume successfully. Jul 31 11:08:51 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7" returned: 0 in 0.408s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:51 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18188349-f59f-4615-b6b8-7f447afa86aa" returned: 0 in 0.284s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-quobyte-18188349-f59f-4615-b6b8-7f447afa86aa" released by "delete_volume" :: held 0.768s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:51 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 Jul 31 11:08:51 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:51 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Created reservations ['66a2e23f-8dfc-4931-8379-eaff9a022a36', '6b88635a-1fb9-41b0-9d1b-8b8929c29316', 'c494d288-d4a0-4014-a642-b50a647a0b2a', 'ad8c1a50-4d3a-4972-8b53-2fd21235f48c'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:52 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:52 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "cinder-31a62896-4495-4188-aec0-f7a6750b89ac-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-31a62896-4495-4188-aec0-f7a6750b89ac-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:52 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ce09792-b279-433d-ac6a-d7e083445ca2 1073741824" returned: 0 in 0.730s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ce09792-b279-433d-ac6a-d7e083445ca2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "cinder-quobyte-31a62896-4495-4188-aec0-f7a6750b89ac" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:52 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ce09792-b279-433d-ac6a-d7e083445ca2 Jul 31 11:08:52 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-quobyte-31a62896-4495-4188-aec0-f7a6750b89ac" acquired by "delete_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a188ff6-4c7f-41b0-8b09-944e494b0c5d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-31a62896-4495-4188-aec0-f7a6750b89ac {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:52 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7" returned: 1 in 0.635s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Downloaded image 809772e9-4d17-4037-b35e-e6996d5ad37c ((None, [{'url': 'file:///opt/stack/data/glance/images/809772e9-4d17-4037-b35e-e6996d5ad37c', 'metadata': {}}])) to volume 1ee991f0-7030-4cd7-b41c-bcc2205f85f7 successfully. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Temporary image 809772e9-4d17-4037-b35e-e6996d5ad37c for user c8bd6f0bb81f4b928ac3f528e08e3921 is deleted. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Marking volume 1ee991f0-7030-4cd7-b41c-bcc2205f85f7 as bootable. {{(pid=89145) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Copying metadata from image 809772e9-4d17-4037-b35e-e6996d5ad37c to 1ee991f0-7030-4cd7-b41c-bcc2205f85f7. {{(pid=89145) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Creating volume glance metadata for volume 1ee991f0-7030-4cd7-b41c-bcc2205f85f7 backed by image 809772e9-4d17-4037-b35e-e6996d5ad37c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '809772e9-4d17-4037-b35e-e6996d5ad37c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e87dd1abc6a9c153f587fa580e5efcbd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89145) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:08:52 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:52 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-31a62896-4495-4188-aec0-f7a6750b89ac Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.498s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:52 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Deleted volume successfully. Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d0363d6b-37e9-44e2-8a23-36e640b6290f tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-18188349-f59f-4615-b6b8-7f447afa86aa-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafa3cd1-58c6-42bf-875b-6bcebc3f8a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7', 'volume_size': 1, 'image_id': '809772e9-4d17-4037-b35e-e6996d5ad37c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/809772e9-4d17-4037-b35e-e6996d5ad37c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e87dd1abc6a9c153f587fa580e5efcbd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c171d9b80a5461fa0d6092226b04fcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63f1f89cfe8449ed62980a318868afada480c96d3bf0d48faa89ba9f86deaec38e643ab9b3eb8a0f21a48744d36db145c906dff48308ff266024a50282fc7bcb', 'id': '809772e9-4d17-4037-b35e-e6996d5ad37c', 'created_at': datetime.datetime(2026, 7, 31, 9, 8, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 8, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/809772e9-4d17-4037-b35e-e6996d5ad37c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3fffa4-e89b-4906-b33e-707f7dd8ecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:52 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Volume volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 (1ee991f0-7030-4cd7-b41c-bcc2205f85f7): created successfully Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3fffa4-e89b-4906-b33e-707f7dd8ecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:52 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Flow 'volume_create_manager' (f2fb7f78-c389-4b61-abff-3457837f8267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ce09792-b279-433d-ac6a-d7e083445ca2" returned: 0 in 0.357s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.511s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349125487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a9eaa92-e126-4728-b533-40c916a2c3eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e239d1e7d98b4d858e8b4358f7983631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:47Z,use_quota=True,user_id='d32cdce3051249cb9630cdf16dc09700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Creating volume 3a9eaa92-e126-4728-b533-40c916a2c3eb {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:52 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a9eaa92-e126-4728-b533-40c916a2c3eb 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f74bbf3b-c6cc-43af-8b9b-78754eacb5a2 tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Created volume successfully. Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a0e820-4b86-4a88-9708-7baedb791fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce09792-b279-433d-ac6a-d7e083445ca2', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:52 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a9eaa92-e126-4728-b533-40c916a2c3eb 1073741824 Jul 31 11:08:52 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231ad85f-16a9-4ef6-b782-abf9778932ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:52 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume volume-1ce09792-b279-433d-ac6a-d7e083445ca2 (1ce09792-b279-433d-ac6a-d7e083445ca2): created successfully Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231ad85f-16a9-4ef6-b782-abf9778932ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Flow 'volume_create_manager' (c7861099-028a-49ec-88f4-8ebc7d404c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8243b330-12c6-4595-8e13-6bb0aa52c434 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created volume successfully. Jul 31 11:08:52 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-31a62896-4495-4188-aec0-f7a6750b89ac" returned: 0 in 0.425s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-31a62896-4495-4188-aec0-f7a6750b89ac {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:52 devstack sudo[108917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-31a62896-4495-4188-aec0-f7a6750b89ac Jul 31 11:08:52 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:53 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Acquiring lock "cinder-1ee991f0-7030-4cd7-b41c-bcc2205f85f7-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-31a62896-4495-4188-aec0-f7a6750b89ac" returned: 0 in 0.338s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Lock "cinder-1ee991f0-7030-4cd7-b41c-bcc2205f85f7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-quobyte-31a62896-4495-4188-aec0-f7a6750b89ac" released by "delete_volume" :: held 0.845s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Acquiring lock "cinder-quobyte-1ee991f0-7030-4cd7-b41c-bcc2205f85f7" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Lock "cinder-quobyte-1ee991f0-7030-4cd7-b41c-bcc2205f85f7" acquired by "delete_volume" :: waited 0.033s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:53 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a9eaa92-e126-4728-b533-40c916a2c3eb 1073741824" returned: 0 in 0.635s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Created reservations ['8a3aac32-5dcc-47ec-87e8-2786a4266c09', '439a7ff9-a50c-4566-92cd-51e834bb8245', 'e6bff434-94ff-4ff2-b6e1-ffa2c13d9baf', '2ac69bf0-cbdd-4ece-a9c1-2b173e838473'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebb5245-1560-4825-9eb5-10ffe46e144f]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a9eaa92-e126-4728-b533-40c916a2c3eb {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:53 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a9eaa92-e126-4728-b533-40c916a2c3eb Jul 31 11:08:53 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:53 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:53 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:53 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 Jul 31 11:08:53 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:53 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a9eaa92-e126-4728-b533-40c916a2c3eb" returned: 0 in 0.319s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.088s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408141650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ba1840-69c0-411f-8952-efe2354702c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e239d1e7d98b4d858e8b4358f7983631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:47Z,use_quota=True,user_id='d32cdce3051249cb9630cdf16dc09700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Creating volume a0ba1840-69c0-411f-8952-efe2354702c0 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:53 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a0ba1840-69c0-411f-8952-efe2354702c0 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19495fb4-9f29-4d4b-84f3-03e7ffd7ec75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a9eaa92-e126-4728-b533-40c916a2c3eb', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:53 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a0ba1840-69c0-411f-8952-efe2354702c0 1073741824 Jul 31 11:08:53 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573a1eee-c383-4046-9dfa-acbefc6c973e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:53 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.314s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:53 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Deleted volume successfully. Jul 31 11:08:53 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume volume-3a9eaa92-e126-4728-b533-40c916a2c3eb (3a9eaa92-e126-4728-b533-40c916a2c3eb): created successfully Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573a1eee-c383-4046-9dfa-acbefc6c973e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Flow 'volume_create_manager' (7b2d6c80-6a3d-4f19-a057-e5fff58def0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:53 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1b365480-ead3-43e4-9bc9-809580e349c2 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created volume successfully. Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8f3956e0-bb32-41dd-9f1f-a59c96ac1e0c tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-31a62896-4495-4188-aec0-f7a6750b89ac-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:53 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7" returned: 0 in 0.517s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:54 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 Jul 31 11:08:54 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:54 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7" returned: 1 in 0.386s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:54 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a0ba1840-69c0-411f-8952-efe2354702c0 1073741824" returned: 0 in 0.545s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:54 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7 Jul 31 11:08:54 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a0ba1840-69c0-411f-8952-efe2354702c0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:54 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a0ba1840-69c0-411f-8952-efe2354702c0 Jul 31 11:08:54 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "cinder-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "cinder-quobyte-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-quobyte-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a155eb60-0260-41ed-ad1f-2dcf86f2f5d8]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:54 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ee991f0-7030-4cd7-b41c-bcc2205f85f7" returned: 0 in 0.353s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Lock "cinder-quobyte-1ee991f0-7030-4cd7-b41c-bcc2205f85f7" released by "delete_volume" :: held 1.351s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Created reservations ['b591c877-cd5b-484b-ab83-740bfe1b6c5f', '312d6b46-cf2c-4dc7-a0c9-dfbf1aa54617', '688541d0-4795-4ad9-bb55-48be7da31d0a', 'e7a9de28-7c37-4d50-9332-9a96a16d9b57'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:54 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a0ba1840-69c0-411f-8952-efe2354702c0" returned: 0 in 0.406s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:54 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47 Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.691s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:54 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-290978458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b797897e-86b3-486b-9570-24ee438a4b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e239d1e7d98b4d858e8b4358f7983631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:48Z,use_quota=True,user_id='d32cdce3051249cb9630cdf16dc09700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Creating volume b797897e-86b3-486b-9570-24ee438a4b5f {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:54 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b797897e-86b3-486b-9570-24ee438a4b5f 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:54 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b797897e-86b3-486b-9570-24ee438a4b5f 1073741824 Jul 31 11:08:54 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5488a5e-87b7-4411-9337-39c193f38005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ba1840-69c0-411f-8952-efe2354702c0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010d57c2-b7da-4d01-90e4-d28ded0dfa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:54 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume volume-a0ba1840-69c0-411f-8952-efe2354702c0 (a0ba1840-69c0-411f-8952-efe2354702c0): created successfully Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010d57c2-b7da-4d01-90e4-d28ded0dfa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Flow 'volume_create_manager' (a9483f3e-73a9-4afe-81da-652e3ac46df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:54 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9711d05b-45f2-4555-a994-f71d2e727815 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created volume successfully. Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:54 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:54 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:55 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47" returned: 0 in 0.490s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:55 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47 Jul 31 11:08:55 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:55 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.273s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:55 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Deleted volume successfully. Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1c2eb155-20bc-49e2-a73f-bbf34189b24e tempest-VolumeAndVolumeTypeFromImageTest-856126494 None] Lock "cinder-1ee991f0-7030-4cd7-b41c-bcc2205f85f7-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:55 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b797897e-86b3-486b-9570-24ee438a4b5f 1073741824" returned: 0 in 0.553s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b797897e-86b3-486b-9570-24ee438a4b5f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:55 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b797897e-86b3-486b-9570-24ee438a4b5f Jul 31 11:08:55 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:55 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47" returned: 0 in 0.364s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-quobyte-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47" released by "delete_volume" :: held 0.918s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Created reservations ['06d79648-a1e0-47d4-9436-f595fd04b700', 'd804abd1-72af-49eb-9ee5-dd588e8e6e5d', '2090f92f-1639-432a-af70-ac0574aefac2', '2d27205a-53ef-43e0-a49b-649708c65488'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:55 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:55 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Flow 'volume_create_manager' (935372db-e71d-4c2f-9da9-30649743e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:55 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a29b24-99b4-4770-a1ba-22203f02fe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b797897e-86b3-486b-9570-24ee438a4b5f" returned: 0 in 0.499s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a29b24-99b4-4770-a1ba-22203f02fe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1475323413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a7019f-73e5-4983-a559-0eb6ac9f512d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac8d77424ac4aa08f328084549cbef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:56Z,use_quota=True,user_id='585864f2ff2d48a2919063865af0a7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a429d0-c245-4377-bf0b-97e23cf3cc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a429d0-c245-4377-bf0b-97e23cf3cc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5641ff-21ba-4e47-a8c3-a151b1eb5d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5641ff-21ba-4e47-a8c3-a151b1eb5d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a7019f-73e5-4983-a559-0eb6ac9f512d', 'volume_name': 'volume-77a7019f-73e5-4983-a559-0eb6ac9f512d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c996bb74-f244-448d-9688-f40323d53988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c996bb74-f244-448d-9688-f40323d53988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c555e10-b029-477d-b4f3-6ef95bc05fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:55 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Volume 77a7019f-73e5-4983-a559-0eb6ac9f512d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a7019f-73e5-4983-a559-0eb6ac9f512d', 'volume_size': 1} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1475323413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a7019f-73e5-4983-a559-0eb6ac9f512d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac8d77424ac4aa08f328084549cbef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:56Z,use_quota=True,user_id='585864f2ff2d48a2919063865af0a7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Creating volume 77a7019f-73e5-4983-a559-0eb6ac9f512d {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:55 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:08:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07261b1-d873-4cda-9730-7f41df510afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b797897e-86b3-486b-9570-24ee438a4b5f', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf58f32-a1fa-4c76-a97b-2a32e625a362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:56 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d 1073741824 Jul 31 11:08:56 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:56 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:56 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Volume volume-b797897e-86b3-486b-9570-24ee438a4b5f (b797897e-86b3-486b-9570-24ee438a4b5f): created successfully Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf58f32-a1fa-4c76-a97b-2a32e625a362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Flow 'volume_create_manager' (fa8eeb54-564e-411a-a2f8-76407f81d3d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.324s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:56 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Deleted volume successfully. Jul 31 11:08:56 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-31a79345-217d-45cc-9c47-5ef4986bb31a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created volume successfully. Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6aa7047d-b96a-4b23-97ae-cbf120d9b4fb tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-d07e67ac-b53e-4ec9-b1e2-1f593ff65e47-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:56 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d 1073741824" returned: 0 in 0.513s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:56 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d Jul 31 11:08:56 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "cinder-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:56 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d" returned: 0 in 0.269s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c555e10-b029-477d-b4f3-6ef95bc05fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a7019f-73e5-4983-a559-0eb6ac9f512d', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e67c31-edf7-4722-8252-ec57ac73acbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:56 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Volume volume-77a7019f-73e5-4983-a559-0eb6ac9f512d (77a7019f-73e5-4983-a559-0eb6ac9f512d): created successfully Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e67c31-edf7-4722-8252-ec57ac73acbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Flow 'volume_create_manager' (935372db-e71d-4c2f-9da9-30649743e041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "cinder-quobyte-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:56 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e5dc92d2-7420-444c-8dc6-785949b5a4e5 tempest-VolumeDependencyTests-1376809699 None] Created volume successfully. Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-quobyte-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3" acquired by "delete_volume" :: waited 0.030s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e416ed06-7339-44bc-a9f1-82151da97844]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-b797897e-86b3-486b-9570-24ee438a4b5f-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-b797897e-86b3-486b-9570-24ee438a4b5f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-quobyte-b797897e-86b3-486b-9570-24ee438a4b5f" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-b797897e-86b3-486b-9570-24ee438a4b5f" acquired by "delete_volume" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af3efd8-168d-4ca9-880b-eae70134113e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b797897e-86b3-486b-9570-24ee438a4b5f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:57 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3 Jul 31 11:08:57 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:57 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b797897e-86b3-486b-9570-24ee438a4b5f Jul 31 11:08:57 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:57 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3" returned: 0 in 0.456s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:57 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3 Jul 31 11:08:57 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:57 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b797897e-86b3-486b-9570-24ee438a4b5f" returned: 0 in 0.397s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b797897e-86b3-486b-9570-24ee438a4b5f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:57 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b797897e-86b3-486b-9570-24ee438a4b5f Jul 31 11:08:57 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:57 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3" returned: 0 in 0.338s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-quobyte-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3" released by "delete_volume" :: held 0.847s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Created reservations ['d12c68c5-95bd-4200-a5cb-5af74beab76f', '07c58720-81e2-4ffa-ab3f-7a30c315a03c', 'ea463117-1bf6-4099-88e3-24ac907f4898', 'f8037ba5-92d3-46eb-9f4d-6032a308b290'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:57 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b797897e-86b3-486b-9570-24ee438a4b5f" returned: 0 in 0.350s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-b797897e-86b3-486b-9570-24ee438a4b5f" released by "delete_volume" :: held 0.808s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:57 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created reservations ['823664e7-235d-4c6a-8cec-e2212cfe33af', '36c5f741-c8d6-4feb-a9be-416901d47358', '2aeee5a1-a551-46af-9cd6-2a511c01fbb8', '1d86b791-aa44-4268-b221-c1c4eab80d85'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "cinder-177ae226-35bf-4937-a1be-de4db079465e-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-177ae226-35bf-4937-a1be-de4db079465e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:58 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:58 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "cinder-quobyte-177ae226-35bf-4937-a1be-de4db079465e" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-a0ba1840-69c0-411f-8952-efe2354702c0-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:58 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:58 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-quobyte-177ae226-35bf-4937-a1be-de4db079465e" acquired by "delete_volume" :: waited 0.098s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a792cb2f-7986-4dc6-87f2-4a40cfbe990a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-177ae226-35bf-4937-a1be-de4db079465e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-a0ba1840-69c0-411f-8952-efe2354702c0-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] Creating offline snapshot e05e0e26-e5d7-41ea-9148-8929f6d2cdff of volume 77a7019f-73e5-4983-a559-0eb6ac9f512d {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-quobyte-a0ba1840-69c0-411f-8952-efe2354702c0" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bac674-20e8-4087-bba5-922a352dc324]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-a0ba1840-69c0-411f-8952-efe2354702c0" acquired by "delete_volume" :: waited 0.076s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:58 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-177ae226-35bf-4937-a1be-de4db079465e Jul 31 11:08:58 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e8521a-a16d-43ec-a702-e0abcfafb36d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a0ba1840-69c0-411f-8952-efe2354702c0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:58 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.535s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:58 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:58 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Deleted volume successfully. Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.362s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:58 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Deleted volume successfully. Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8f6c703c-4384-4cb6-9800-f6e3e6082707 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-822ac8b7-29d0-49b4-b5cb-7c19c0dffab3-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-58977e05-ba9a-4e56-973a-125985589ada tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-b797897e-86b3-486b-9570-24ee438a4b5f-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:58 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d Jul 31 11:08:58 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:58 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a0ba1840-69c0-411f-8952-efe2354702c0 Jul 31 11:08:58 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:58 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-177ae226-35bf-4937-a1be-de4db079465e" returned: 0 in 0.519s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-177ae226-35bf-4937-a1be-de4db079465e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:58 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-177ae226-35bf-4937-a1be-de4db079465e Jul 31 11:08:58 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:59 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d" returned: 0 in 0.553s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:59 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a0ba1840-69c0-411f-8952-efe2354702c0" returned: 0 in 0.493s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a0ba1840-69c0-411f-8952-efe2354702c0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:59 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff 1G Jul 31 11:08:59 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:59 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a0ba1840-69c0-411f-8952-efe2354702c0 Jul 31 11:08:59 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:59 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-177ae226-35bf-4937-a1be-de4db079465e" returned: 0 in 0.402s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-quobyte-177ae226-35bf-4937-a1be-de4db079465e" released by "delete_volume" :: held 0.994s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Created reservations ['f0d5bb8d-2c06-428d-a59c-3e4aba8aad3d', '6a2e0a2f-d1ea-4f7f-9a88-ea53d6ba960e', '6d619eb1-6d2c-4cd3-8bd4-3ee46fe24f3f', '11fb0285-5496-4a03-91a3-c18e8c9a2930'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:59 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a0ba1840-69c0-411f-8952-efe2354702c0" returned: 0 in 0.336s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-a0ba1840-69c0-411f-8952-efe2354702c0" released by "delete_volume" :: held 0.889s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created reservations ['afb398fe-05e8-431a-bc00-914275c4cb16', '36162367-a0fc-4174-9c0e-adddc9493b01', '5543914f-aac3-456d-8673-aaa76138fd97', 'd95da48d-6451-4da1-89e8-b5a7bf19ba53'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:59 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:59 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:59 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff 1G" returned: 0 in 0.550s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a7019f-73e5-4983-a559-0eb6ac9f512d -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:59 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a7019f-73e5-4983-a559-0eb6ac9f512d -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff Jul 31 11:08:59 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:59 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:08:59 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:59 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.295s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:59 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Deleted volume successfully. Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5e9664f8-c9aa-4c73-b9b1-492bdff93a43 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-177ae226-35bf-4937-a1be-de4db079465e-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:59 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.272s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:59 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Deleted volume successfully. Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1277689a-49e3-4c1f-8a97-d9af4df16951 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-a0ba1840-69c0-411f-8952-efe2354702c0-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:59 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a7019f-73e5-4983-a559-0eb6ac9f512d -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff" returned: 0 in 0.391s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:59 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff is being set with open permissions: ugo+rw Jul 31 11:08:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:59 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff Jul 31 11:08:59 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:00 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff" returned: 0 in 0.256s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:00 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.info Jul 31 11:09:00 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "cinder-086d3279-cdcc-4a8e-b876-fff34b0fa99c-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-086d3279-cdcc-4a8e-b876-fff34b0fa99c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "cinder-quobyte-086d3279-cdcc-4a8e-b876-fff34b0fa99c" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-quobyte-086d3279-cdcc-4a8e-b876-fff34b0fa99c" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ad8276-7fb2-460b-9fca-eb6af42d230d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:00 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c Jul 31 11:09:00 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-3a9eaa92-e126-4728-b533-40c916a2c3eb-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-3a9eaa92-e126-4728-b533-40c916a2c3eb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:00 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.info" returned: 0 in 0.370s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:00 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.info is being set with open permissions: ugo+rw Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:00 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.info Jul 31 11:09:00 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-quobyte-3a9eaa92-e126-4728-b533-40c916a2c3eb" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-3a9eaa92-e126-4728-b533-40c916a2c3eb" acquired by "delete_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e302a2fe-ef0b-4490-bdaf-c0eae4d92ff5]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a9eaa92-e126-4728-b533-40c916a2c3eb {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:00 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a9eaa92-e126-4728-b533-40c916a2c3eb Jul 31 11:09:00 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:00 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c" returned: 0 in 0.468s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:00 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.info" returned: 0 in 0.302s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:00 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c Jul 31 11:09:00 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.568s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:01 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f48375ec-8062-4252-ae01-2f613b7f4c7d tempest-VolumeDependencyTests-1376809699 None] Create snapshot completed successfully Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Flow 'volume_create_manager' (999d2d4e-d252-4a8d-a414-4c8f469b3e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231fd6f6-2e4a-40d6-be6b-7946c26a6500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:01 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a9eaa92-e126-4728-b533-40c916a2c3eb" returned: 0 in 0.472s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a9eaa92-e126-4728-b533-40c916a2c3eb {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231fd6f6-2e4a-40d6-be6b-7946c26a6500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e21dec2-bf23-4acc-9905-ee0ea036ab53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0def701a417d49f28fb7caad08e2fef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:01Z,use_quota=True,user_id='4b897581525a4025b8134b9fc5cc01de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:01 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e658b7-9389-4f27-9ace-9b54deef4fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e658b7-9389-4f27-9ace-9b54deef4fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:01 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a9eaa92-e126-4728-b533-40c916a2c3eb Jul 31 11:09:01 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb825227-cc3d-4521-8e6c-a92ad183acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb825227-cc3d-4521-8e6c-a92ad183acd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e21dec2-bf23-4acc-9905-ee0ea036ab53', 'volume_name': 'volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a0c1ac-d305-46ce-a0a3-931cd4f7d04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a0c1ac-d305-46ce-a0a3-931cd4f7d04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e05c775-22bd-4aae-878e-6dbb24133c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:01 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Volume 3e21dec2-bf23-4acc-9905-ee0ea036ab53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53', 'volume_size': 1} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e21dec2-bf23-4acc-9905-ee0ea036ab53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0def701a417d49f28fb7caad08e2fef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:01Z,use_quota=True,user_id='4b897581525a4025b8134b9fc5cc01de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Creating volume 3e21dec2-bf23-4acc-9905-ee0ea036ab53 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:09:01 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-086d3279-cdcc-4a8e-b876-fff34b0fa99c" returned: 0 in 0.390s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:01 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53 1073741824 Jul 31 11:09:01 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-quobyte-086d3279-cdcc-4a8e-b876-fff34b0fa99c" released by "delete_volume" :: held 0.915s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Created reservations ['62192f20-8f98-409b-85c8-664300211624', '557d1a8d-afa4-4e55-8b42-da74e6c451b1', '7125b4af-e01e-452d-8f0e-6bce0b87c653', '422783f8-1850-4bb5-844e-e134545ce79d'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:01 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3a9eaa92-e126-4728-b533-40c916a2c3eb" returned: 0 in 0.358s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:01 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:01 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-3a9eaa92-e126-4728-b533-40c916a2c3eb" released by "delete_volume" :: held 0.897s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created reservations ['870452d5-6f89-4493-9caf-08bf52a26980', 'c40e4364-b313-44dc-a706-9c1713b81892', '8edaecb8-0feb-44be-8ff2-6cdb898923ec', '23d440e4-f6e5-4acc-ae28-16e74dbcc97d'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-1ce09792-b279-433d-ac6a-d7e083445ca2-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:01 devstack sudo[109076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:01 devstack sudo[109076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-1ce09792-b279-433d-ac6a-d7e083445ca2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-quobyte-1ce09792-b279-433d-ac6a-d7e083445ca2" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:01 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.367s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-1ce09792-b279-433d-ac6a-d7e083445ca2" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:01 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Deleted volume successfully. Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[24616453-5359-4301-af17-a254ce54ae8d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ce09792-b279-433d-ac6a-d7e083445ca2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-97a04651-6962-4e79-8192-0306dfcf8f49 tempest-CreateVolumesFromSourceVolumeTest-826605050 None] Lock "cinder-086d3279-cdcc-4a8e-b876-fff34b0fa99c-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:02 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53 1073741824" returned: 0 in 0.721s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:02 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53 Jul 31 11:09:02 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:02 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ce09792-b279-433d-ac6a-d7e083445ca2 Jul 31 11:09:02 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:02 devstack sudo[109076]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.437s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:02 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Deleted volume successfully. Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-1d126d80-d428-46e8-bbef-ba370868ab89 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-3a9eaa92-e126-4728-b533-40c916a2c3eb-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Flow 'volume_create_manager' (9758825c-9ca9-42ca-8516-c28254419512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16da5a9-4c77-4c14-b0a3-ab949bf38f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16da5a9-4c77-4c14-b0a3-ab949bf38f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1933838342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf82f66a-ddae-492b-8db7-c240c9dd6cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac8d77424ac4aa08f328084549cbef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e05e0e26-e5d7-41ea-9148-8929f6d2cdff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:02Z,use_quota=True,user_id='585864f2ff2d48a2919063865af0a7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69711451-9f9f-4157-aebe-f6a1209b6a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69711451-9f9f-4157-aebe-f6a1209b6a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ac558b-cb40-4b67-b52e-6a381c5fc0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ac558b-cb40-4b67-b52e-6a381c5fc0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf82f66a-ddae-492b-8db7-c240c9dd6cfc', 'volume_name': 'volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc', 'volume_size': 1, 'snapshot_id': 'e05e0e26-e5d7-41ea-9148-8929f6d2cdff'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696d5553-63f5-4843-a1a8-12e436ddd2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:02 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696d5553-63f5-4843-a1a8-12e436ddd2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b609455-1b28-4fae-a4e3-d88fd5e83a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:02 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Volume bf82f66a-ddae-492b-8db7-c240c9dd6cfc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc', 'volume_size': 1, 'snapshot_id': 'e05e0e26-e5d7-41ea-9148-8929f6d2cdff'} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53" returned: 0 in 0.399s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "cinder-quobyte-e05e0e26-e5d7-41ea-9148-8929f6d2cdff-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" by "_create_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e05c775-22bd-4aae-878e-6dbb24133c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1273a6-47b3-44c5-bc94-c44d2acd1c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-quobyte-e05e0e26-e5d7-41ea-9148-8929f6d2cdff-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Creating volume bf82f66a-ddae-492b-8db7-c240c9dd6cfc from snapshot e05e0e26-e5d7-41ea-9148-8929f6d2cdff {{(pid=89145) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "cinder-quobyte-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" by "_copy_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:02 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Volume volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53 (3e21dec2-bf23-4acc-9905-ee0ea036ab53): created successfully Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1273a6-47b3-44c5-bc94-c44d2acd1c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Flow 'volume_create_manager' (999d2d4e-d252-4a8d-a414-4c8f469b3e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:02 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ce09792-b279-433d-ac6a-d7e083445ca2" returned: 0 in 0.538s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ce09792-b279-433d-ac6a-d7e083445ca2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-quobyte-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] snapshot: e05e0e26-e5d7-41ea-9148-8929f6d2cdff, volume: bf82f66a-ddae-492b-8db7-c240c9dd6cfc, {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:09:02 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-fc905c68-b1a9-47e8-9556-66c98d7c8a18 tempest-CinderUnicodeTest-667505 None] Created volume successfully. Jul 31 11:09:02 devstack sudo[109090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ce09792-b279-433d-ac6a-d7e083445ca2 Jul 31 11:09:02 devstack sudo[109090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bee1ec-8168-4dde-9967-45da2f8dc00a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:02 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff Jul 31 11:09:02 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:02 devstack sudo[109090]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-1ce09792-b279-433d-ac6a-d7e083445ca2" returned: 0 in 0.302s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-1ce09792-b279-433d-ac6a-d7e083445ca2" released by "delete_volume" :: held 0.906s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created reservations ['5437120e-2df4-415e-95f5-d1fb38684432', '04d1d770-8a02-4a03-ab00-bb8d45405a6c', '94b2aee2-f02c-4753-9cc5-5683e40cd0f0', 'b4c39b53-e1f9-46a8-81e9-61c044c5628b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:03 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff" returned: 0 in 0.401s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77a7019f-73e5-4983-a559-0eb6ac9f512d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:09:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:09:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Creating direct copy from snapshot {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:09:03 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:03 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:03 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fe0b54-0452-4cd8-9ef1-26500f7118c1]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:03 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d Jul 31 11:09:03 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:03 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.299s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:03 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:03 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Deleted volume successfully. Jul 31 11:09:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-86a244d0-982a-4f75-8875-96c52317aa4a tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-1ce09792-b279-433d-ac6a-d7e083445ca2-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:03 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d" returned: 0 in 0.460s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:03 devstack cinder-volume[89145]: DEBUG cinder.utils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Path /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc not found in is_blk_device check {{(pid=89145) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:09:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:03 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc Jul 31 11:09:03 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Flow 'volume_create_manager' (4e3d7cc3-80d1-4abe-bbae-68d3d266f07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d06984-8c75-4f7d-9604-58f472991f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d06984-8c75-4f7d-9604-58f472991f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1569778243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3efce8d-8c38-474f-8f66-aa8a7b08f15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0def701a417d49f28fb7caad08e2fef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:04Z,use_quota=True,user_id='4b897581525a4025b8134b9fc5cc01de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a56f03-379c-49a6-9a00-b6959544e69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a56f03-379c-49a6-9a00-b6959544e69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb70f3f-332e-4477-a860-7e304984c402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb70f3f-332e-4477-a860-7e304984c402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3efce8d-8c38-474f-8f66-aa8a7b08f15b', 'volume_name': 'volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837b5a83-0574-4953-93a6-b7ee5c66fa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837b5a83-0574-4953-93a6-b7ee5c66fa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30dacfd3-759f-463b-8538-16b197006ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:04 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Volume a3efce8d-8c38-474f-8f66-aa8a7b08f15b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b', 'volume_size': 1} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-17d2427c-2c62-4e91-b679-240a6f04b6e3-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-17d2427c-2c62-4e91-b679-240a6f04b6e3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-quobyte-17d2427c-2c62-4e91-b679-240a6f04b6e3" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-17d2427c-2c62-4e91-b679-240a6f04b6e3" acquired by "delete_volume" :: waited 0.031s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9ee8e7-eb18-462a-ab7c-a778c9b47f35]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d2427c-2c62-4e91-b679-240a6f04b6e3 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:04 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d2427c-2c62-4e91-b679-240a6f04b6e3 Jul 31 11:09:04 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:05 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d2427c-2c62-4e91-b679-240a6f04b6e3" returned: 0 in 0.895s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d2427c-2c62-4e91-b679-240a6f04b6e3 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:05 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d2427c-2c62-4e91-b679-240a6f04b6e3 Jul 31 11:09:05 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:05 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-17d2427c-2c62-4e91-b679-240a6f04b6e3" returned: 0 in 0.591s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:05 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-17d2427c-2c62-4e91-b679-240a6f04b6e3" released by "delete_volume" :: held 1.611s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created reservations ['80273da0-b7b0-426b-af8f-b76a51229ada', '992b9e30-8be8-48bf-bcfa-4961cd9e774e', '1174906d-1734-4adf-b4bc-86d3a6f5afc0', '445bc92f-49cd-41c6-9dec-c88576ad7e03'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:06 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:06 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:06 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.555s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:06 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Deleted volume successfully. Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-d5332cbc-2528-4eec-9a27-b67998d0a45c-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-d5332cbc-2528-4eec-9a27-b67998d0a45c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-quobyte-165b1a3a-162a-4189-9522-bdeecfddfe31" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-913ed158-c7ec-4bd5-8aaa-696026e1f9e6 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-17d2427c-2c62-4e91-b679-240a6f04b6e3-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-165b1a3a-162a-4189-9522-bdeecfddfe31" acquired by "delete_snapshot" :: waited 0.048s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-quobyte-d5332cbc-2528-4eec-9a27-b67998d0a45c" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-d5332cbc-2528-4eec-9a27-b67998d0a45c" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Deleting offline snapshot d5332cbc-2528-4eec-9a27-b67998d0a45c of volume 165b1a3a-162a-4189-9522-bdeecfddfe31 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:09:07 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] snapshot_file for this snap is: volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:09:07 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc96ead-4110-4983-b141-5d88be09542b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:07 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c Jul 31 11:09:07 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:08 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c" returned: 0 in 1.039s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-165b1a3a-162a-4189-9522-bdeecfddfe31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[397b73e6-019d-45f3-a9d1-310e7e54702a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:08 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:08 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:08 devstack sudo[109136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 Jul 31 11:09:08 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:08 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31" returned: 0 in 0.674s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:08 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c Jul 31 11:09:08 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:09 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.885s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:09:09 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" returned: 0 in 5.720s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e229e9ee-4ddf-458d-9f09-cdb4cddfed4c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:09 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d Jul 31 11:09:09 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:09 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c" returned: 0 in 0.607s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:09 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c Jul 31 11:09:09 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:09 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31.d5332cbc-2528-4eec-9a27-b67998d0a45c" returned: 0 in 0.287s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-d5332cbc-2528-4eec-9a27-b67998d0a45c" released by "_delete_snapshot" :: held 2.838s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-165b1a3a-162a-4189-9522-bdeecfddfe31" released by "delete_snapshot" :: held 2.889s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:09 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d" returned: 0 in 0.653s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:09:09 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Converted 1024.00 MB image at 178.99 MB/s Jul 31 11:09:09 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc is being set with open permissions: ugo+rw Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created reservations ['77aeefde-ae64-43f3-9569-74a32f788750', '60909555-fe65-4d21-a906-327856ddaaec', 'ec3d7b4e-9d22-4ddb-99dd-8a68820dfabb', 'f4f65406-7e13-4497-b611-a56731fb99aa'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:09 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc Jul 31 11:09:09 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:09 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Delete snapshot completed successfully. Jul 31 11:09:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5a87f8fd-700d-42b9-ac58-4381e2c9a7d9 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-d5332cbc-2528-4eec-9a27-b67998d0a45c-delete_snapshot" released by "delete_snapshot" :: held 3.107s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:10 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" returned: 0 in 0.269s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-quobyte-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" released by "_copy_volume_from_snapshot" :: held 7.626s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-quobyte-e05e0e26-e5d7-41ea-9148-8929f6d2cdff-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" released by "_create_volume_from_snapshot" :: held 7.689s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.725s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.044s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1569778243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3efce8d-8c38-474f-8f66-aa8a7b08f15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0def701a417d49f28fb7caad08e2fef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:04Z,use_quota=True,user_id='4b897581525a4025b8134b9fc5cc01de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Creating volume a3efce8d-8c38-474f-8f66-aa8a7b08f15b {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:09:10 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-165b1a3a-162a-4189-9522-bdeecfddfe31-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:10 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b 1073741824 Jul 31 11:09:10 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-165b1a3a-162a-4189-9522-bdeecfddfe31-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b609455-1b28-4fae-a4e3-d88fd5e83a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc', 'volume_size': 1, 'snapshot_id': 'e05e0e26-e5d7-41ea-9148-8929f6d2cdff'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5bdb30-fa73-4b58-984b-44d172d17690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:10 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Volume volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc (bf82f66a-ddae-492b-8db7-c240c9dd6cfc): created successfully Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5bdb30-fa73-4b58-984b-44d172d17690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Flow 'volume_create_manager' (9758825c-9ca9-42ca-8516-c28254419512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "cinder-quobyte-165b1a3a-162a-4189-9522-bdeecfddfe31" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ca64d31d-05bc-445e-b6ba-b435ab5fc522 tempest-VolumeDependencyTests-1376809699 None] Created volume successfully. Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-165b1a3a-162a-4189-9522-bdeecfddfe31" acquired by "delete_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc941a3-3172-4097-b200-054e0ce3a958]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:10 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 Jul 31 11:09:10 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:10 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b 1073741824" returned: 0 in 0.445s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:10 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b Jul 31 11:09:10 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:10 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31" returned: 0 in 0.384s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:10 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31 Jul 31 11:09:10 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:10 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b" returned: 0 in 0.270s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30dacfd3-759f-463b-8538-16b197006ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8437efc7-b38b-4b64-8415-5a8d46038a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:10 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Volume volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b (a3efce8d-8c38-474f-8f66-aa8a7b08f15b): created successfully Jul 31 11:09:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8437efc7-b38b-4b64-8415-5a8d46038a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Flow 'volume_create_manager' (4e3d7cc3-80d1-4abe-bbae-68d3d266f07e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:11 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8c5abdc9-83db-4473-ab2d-61faa920f952 tempest-CinderUnicodeTest-667505 None] Created volume successfully. Jul 31 11:09:11 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-165b1a3a-162a-4189-9522-bdeecfddfe31" returned: 0 in 0.269s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-quobyte-165b1a3a-162a-4189-9522-bdeecfddfe31" released by "delete_volume" :: held 0.717s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Created reservations ['943ff7d8-f015-4ce2-83ef-ef821c824f9a', '6031145e-fa32-4ff6-a9b2-abfa1d587364', '74d68d3e-8d42-4524-ae66-ba33403f11a6', 'be12ce37-faee-41e2-b490-3501c719e940'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:11 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:11 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "cinder-e05e0e26-e5d7-41ea-9148-8929f6d2cdff-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-e05e0e26-e5d7-41ea-9148-8929f6d2cdff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "cinder-quobyte-77a7019f-73e5-4983-a559-0eb6ac9f512d" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-quobyte-77a7019f-73e5-4983-a559-0eb6ac9f512d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "cinder-quobyte-e05e0e26-e5d7-41ea-9148-8929f6d2cdff" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:11 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.317s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-quobyte-e05e0e26-e5d7-41ea-9148-8929f6d2cdff" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Deleting offline snapshot e05e0e26-e5d7-41ea-9148-8929f6d2cdff of volume 77a7019f-73e5-4983-a559-0eb6ac9f512d {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] snapshot_file for this snap is: volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:09:11 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Deleted volume successfully. Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2e6336-6ba0-4842-bb9c-66979297c693]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ea22ebe-c827-4b6e-b872-9c59773ddd25 tempest-CreateVolumesFromSnapshotTest-1092002861 None] Lock "cinder-165b1a3a-162a-4189-9522-bdeecfddfe31-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:11 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff Jul 31 11:09:11 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:12 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff" returned: 0 in 0.502s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77a7019f-73e5-4983-a559-0eb6ac9f512d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c89c10c-e8f5-4eef-8a18-09d9430c77bd]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:12 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d Jul 31 11:09:12 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] Creating offline snapshot e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 of volume a3efce8d-8c38-474f-8f66-aa8a7b08f15b {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2376b03a-43d4-44ab-a690-1ab204771887]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:12 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b Jul 31 11:09:12 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:12 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d" returned: 0 in 0.460s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:12 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff Jul 31 11:09:12 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:12 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b" returned: 0 in 0.404s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:12 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 1G Jul 31 11:09:12 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:12 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff" returned: 0 in 0.436s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:13 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff Jul 31 11:09:13 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:13 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d.e05e0e26-e5d7-41ea-9148-8929f6d2cdff" returned: 0 in 0.323s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:13 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 1G" returned: 0 in 0.606s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:13 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 Jul 31 11:09:13 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-quobyte-e05e0e26-e5d7-41ea-9148-8929f6d2cdff" released by "_delete_snapshot" :: held 1.887s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-quobyte-77a7019f-73e5-4983-a559-0eb6ac9f512d" released by "delete_snapshot" :: held 1.923s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:13 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Created reservations ['1a7c95a7-6ae8-4af5-9c2e-efa4b1f13f95', '0226a859-d9b7-4891-8597-25b5558a6550', '6f3aa03b-330f-43d4-9829-b736f8efd84b', '7e80ae43-b388-40bc-aac1-a86c14611856'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:13 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Delete snapshot completed successfully. Jul 31 11:09:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ef3e3fa-5299-42fd-b890-06ed71862ccd tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-e05e0e26-e5d7-41ea-9148-8929f6d2cdff-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:13 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806" returned: 0 in 0.363s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:13 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 is being set with open permissions: ugo+rw Jul 31 11:09:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:13 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 Jul 31 11:09:13 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:13 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806" returned: 0 in 0.275s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:14 devstack sudo[109217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.info Jul 31 11:09:14 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:14 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.info" returned: 0 in 0.256s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:14 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.info is being set with open permissions: ugo+rw Jul 31 11:09:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:14 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.info Jul 31 11:09:14 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:14 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.info" returned: 0 in 0.266s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:14 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f048a564-3700-48a7-9429-7ea9a248fc67 tempest-CinderUnicodeTest-667505 None] Create snapshot completed successfully Jul 31 11:09:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "cinder-77a7019f-73e5-4983-a559-0eb6ac9f512d-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-77a7019f-73e5-4983-a559-0eb6ac9f512d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "cinder-quobyte-77a7019f-73e5-4983-a559-0eb6ac9f512d" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-quobyte-77a7019f-73e5-4983-a559-0eb6ac9f512d" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:14 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bd2267-5e0c-436a-b1c1-6471ab5aa22c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:14 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d Jul 31 11:09:14 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:15 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d" returned: 0 in 0.444s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:15 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d Jul 31 11:09:15 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:15 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-77a7019f-73e5-4983-a559-0eb6ac9f512d" returned: 0 in 0.285s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Acquiring lock "cinder-e9b3ec6a-83b6-4124-85c1-8ca88ee9d806-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-quobyte-77a7019f-73e5-4983-a559-0eb6ac9f512d" released by "delete_volume" :: held 0.823s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Lock "cinder-e9b3ec6a-83b6-4124-85c1-8ca88ee9d806-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Acquiring lock "cinder-quobyte-a3efce8d-8c38-474f-8f66-aa8a7b08f15b" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Lock "cinder-quobyte-a3efce8d-8c38-474f-8f66-aa8a7b08f15b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Acquiring lock "cinder-quobyte-e9b3ec6a-83b6-4124-85c1-8ca88ee9d806" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Lock "cinder-quobyte-e9b3ec6a-83b6-4124-85c1-8ca88ee9d806" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Deleting offline snapshot e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 of volume a3efce8d-8c38-474f-8f66-aa8a7b08f15b {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] snapshot_file for this snap is: volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8708a251-8290-4fc4-83a5-b02a7a3173ec]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Created reservations ['8576855a-3b6f-468f-b442-33cbec352311', 'f5f2492c-35cb-42a0-82f6-2e3ff3d25a44', 'fd65c124-0a07-4454-9f27-593a85dc2065', '5e61f9d1-a0d6-4998-992e-b8f841fa72a2'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:15 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:15 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:15 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 Jul 31 11:09:15 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "cinder-bf82f66a-ddae-492b-8db7-c240c9dd6cfc-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-bf82f66a-ddae-492b-8db7-c240c9dd6cfc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "cinder-quobyte-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-quobyte-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" acquired by "delete_volume" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aed46c5-e549-4df8-91fc-b42847ecb956]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:16 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806" returned: 0 in 0.501s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:09:16 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc Jul 31 11:09:16 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d642ef4-f776-4d3c-b48d-8c2dcd0bd53b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:16 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.457s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:16 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Deleted volume successfully. Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f1a0ae4c-2762-48b7-bedd-1e65b6a0d3ba tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-77a7019f-73e5-4983-a559-0eb6ac9f512d-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:16 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b Jul 31 11:09:16 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:16 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" returned: 0 in 0.508s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:16 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc Jul 31 11:09:16 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:16 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b" returned: 0 in 0.556s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:16 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 Jul 31 11:09:16 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:16 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" returned: 0 in 0.334s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-quobyte-bf82f66a-ddae-492b-8db7-c240c9dd6cfc" released by "delete_volume" :: held 0.906s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:16 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Created reservations ['0d81a71a-7bbf-4708-922d-8bf5da919d99', '60584623-a571-4c6b-a499-a2f9ccbfd571', '36b155a2-daa3-4bd9-bcd2-7cf7e3a98c67', '4fa300c8-c3ec-44b8-b9f1-a42050561833'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:17 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:17 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:17 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806" returned: 0 in 0.605s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:17 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806 Jul 31 11:09:17 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:17 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.396s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:17 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Deleted volume successfully. Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3de31de9-3e8a-40b5-b3ba-9ef1a1c67f28 tempest-VolumeDependencyTests-1376809699 None] Lock "cinder-bf82f66a-ddae-492b-8db7-c240c9dd6cfc-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:17 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b.e9b3ec6a-83b6-4124-85c1-8ca88ee9d806" returned: 0 in 0.365s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Lock "cinder-quobyte-e9b3ec6a-83b6-4124-85c1-8ca88ee9d806" released by "_delete_snapshot" :: held 2.184s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Lock "cinder-quobyte-a3efce8d-8c38-474f-8f66-aa8a7b08f15b" released by "delete_snapshot" :: held 2.215s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Created reservations ['36989d3d-7072-4be1-a000-4c47364b319f', '4e5d4c98-eaf1-4c39-9c72-6d494bf40181', '64fcb46d-bd63-45a1-b464-0b0fde5865d9', '9446b0d1-bd7d-4bcd-9027-9155197b2944'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Flow 'volume_create_manager' (8adf200c-0843-441f-8089-0292d4bd91a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6078f36-5725-4f3e-9382-7fc1eb6922f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6078f36-5725-4f3e-9382-7fc1eb6922f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b5a3a3-5ef7-4857-94f3-3eeee5af3d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b16fd2f7d249f183d4ad02498d30b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:18Z,use_quota=True,user_id='9b1645e9c9af4235b7f80edf01b389d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228869e4-3410-4a10-9f89-6099c87539fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228869e4-3410-4a10-9f89-6099c87539fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c0c190-e08c-4d7b-a3c1-48cd0c6b309e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.image.glance [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Creating Keystone auth plugin from conf {{(pid=89145) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:09:18 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Delete snapshot completed successfully. Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d514695b-56b1-43bd-bf0f-144e352a0cc9 tempest-CinderUnicodeTest-667505 None] Lock "cinder-e9b3ec6a-83b6-4124-85c1-8ca88ee9d806-delete_snapshot" released by "delete_snapshot" :: held 2.491s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c0c190-e08c-4d7b-a3c1-48cd0c6b309e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '76b5a3a3-5ef7-4857-94f3-3eeee5af3d26', 'volume_name': 'volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26', 'volume_size': 1, 'image_id': 'b6ac3832-c578-4886-b5b2-5866923901d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6ac3832-c578-4886-b5b2-5866923901d4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f0b880678c036e6df802949f3a3cb178', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2b16fd2f7d249f183d4ad02498d30b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e32432d4e6a38989310d6725af136c6d5ef354abcb092154f56655a06e0c321b5a4f74f63a7bf06c4f2da556b14b18fc73ba9dbe2ae065dba7fcf96a39ba83a', 'id': 'b6ac3832-c578-4886-b5b2-5866923901d4', 'created_at': datetime.datetime(2026, 7, 31, 9, 9, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 9, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6ac3832-c578-4886-b5b2-5866923901d4/file', 'properties': {}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e6a0c2-17da-4106-b361-27feda5a559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e6a0c2-17da-4106-b361-27feda5a559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2bffc5-2e5c-4802-8389-e6aa19336de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:18 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Volume 76b5a3a3-5ef7-4857-94f3-3eeee5af3d26: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26', 'volume_size': 1, 'image_id': 'b6ac3832-c578-4886-b5b2-5866923901d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6ac3832-c578-4886-b5b2-5866923901d4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f0b880678c036e6df802949f3a3cb178', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2b16fd2f7d249f183d4ad02498d30b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e32432d4e6a38989310d6725af136c6d5ef354abcb092154f56655a06e0c321b5a4f74f63a7bf06c4f2da556b14b18fc73ba9dbe2ae065dba7fcf96a39ba83a', 'id': 'b6ac3832-c578-4886-b5b2-5866923901d4', 'created_at': datetime.datetime(2026, 7, 31, 9, 9, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 9, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6ac3832-c578-4886-b5b2-5866923901d4/file', 'properties': {}}, 'image_service': } Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Trying to clone 76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 from image b6ac3832-c578-4886-b5b2-5866923901d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b6ac3832-c578-4886-b5b2-5866923901d4', 'metadata': {}}]). {{(pid=89145) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:09:18 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Image download 0.00 MB at 0.00 MB/s Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Acquiring lock "cinder-a3efce8d-8c38-474f-8f66-aa8a7b08f15b-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Lock "cinder-a3efce8d-8c38-474f-8f66-aa8a7b08f15b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3175f3c4-de1b-4a6c-9d27-189a9643e522]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Acquiring lock "cinder-quobyte-a3efce8d-8c38-474f-8f66-aa8a7b08f15b" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Lock "cinder-quobyte-a3efce8d-8c38-474f-8f66-aa8a7b08f15b" acquired by "delete_volume" :: waited 0.033s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:18 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD Jul 31 11:09:18 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[df31d0d4-157c-41dd-aeea-1e06f0a6aff0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:19 devstack sudo[109267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b Jul 31 11:09:19 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:19 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:19 devstack sudo[109271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD Jul 31 11:09:19 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:19 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b" returned: 0 in 0.457s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:19 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b Jul 31 11:09:19 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:19 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD" returned: 1 in 0.496s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:09:19 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Temporary image b6ac3832-c578-4886-b5b2-5866923901d4 is fetched for user 9b1645e9c9af4235b7f80edf01b389d5. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:09:19 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a3efce8d-8c38-474f-8f66-aa8a7b08f15b" returned: 0 in 0.371s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:19 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[88089f59-b7f3-4795-969e-f82641725ba1]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:19 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Lock "cinder-quobyte-a3efce8d-8c38-474f-8f66-aa8a7b08f15b" released by "delete_volume" :: held 0.929s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:19 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Created reservations ['3dcadd79-aac7-4c64-af48-2157bb138858', '5c0725f3-2f86-4d3b-8143-6f964b9cb9b6', 'd1a17fb8-8771-4c6d-b91e-9ab01cb7e055', 'feda69b6-1c93-4a40-bd8b-9f7c0c17ac11'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:20 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:20 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:20 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD Jul 31 11:09:20 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:20 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD" returned: 0 in 0.577s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:20 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.440s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:20 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Deleted volume successfully. Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-86ce2ef0-e77f-4a8a-a9c2-f48d3316910a tempest-CinderUnicodeTest-667505 None] Lock "cinder-a3efce8d-8c38-474f-8f66-aa8a7b08f15b-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:20 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD Jul 31 11:09:20 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Flow 'volume_create_manager' (4b237db7-1a55-4355-847a-826841541f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ffbd08-2b57-4404-9de2-cb528af2716f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ffbd08-2b57-4404-9de2-cb528af2716f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879853936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c99cb00-cef8-465c-9267-86ad01ca423e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f0fdf5ecb2402192c07d84fe8a5fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:21Z,use_quota=True,user_id='b4abaccfbc4348319434b4d21496ea69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab44d2d8-8140-4c12-96dc-de61d01cf625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab44d2d8-8140-4c12-96dc-de61d01cf625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3b8087-6271-4c4d-9211-7d5046c5bbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3b8087-6271-4c4d-9211-7d5046c5bbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c99cb00-cef8-465c-9267-86ad01ca423e', 'volume_name': 'volume-4c99cb00-cef8-465c-9267-86ad01ca423e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:20 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b064bf-8098-4eb0-b2dc-89e59f76628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b064bf-8098-4eb0-b2dc-89e59f76628d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31684327-d0e1-4880-990c-fe5c6688386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:20 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Volume 4c99cb00-cef8-465c-9267-86ad01ca423e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c99cb00-cef8-465c-9267-86ad01ca423e', 'volume_size': 1} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879853936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c99cb00-cef8-465c-9267-86ad01ca423e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f0fdf5ecb2402192c07d84fe8a5fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:21Z,use_quota=True,user_id='b4abaccfbc4348319434b4d21496ea69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Creating volume 4c99cb00-cef8-465c-9267-86ad01ca423e {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:09:20 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4c99cb00-cef8-465c-9267-86ad01ca423e 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD" returned: 1 in 0.486s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:09:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:20 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4c99cb00-cef8-465c-9267-86ad01ca423e 1073741824 Jul 31 11:09:20 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Acquiring lock "cinder-3e21dec2-bf23-4acc-9905-ee0ea036ab53-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Lock "cinder-3e21dec2-bf23-4acc-9905-ee0ea036ab53-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Acquiring lock "cinder-quobyte-3e21dec2-bf23-4acc-9905-ee0ea036ab53" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Lock "cinder-quobyte-3e21dec2-bf23-4acc-9905-ee0ea036ab53" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[3277e0ba-eb36-4ff4-8e70-fe176c3d6add]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:21 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53 Jul 31 11:09:21 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a6e20ffe-7e2a-49e0-ba55-18c85ffca957 tempest-ProjectAdminTests-1062309113 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6408653259277, 'free_capacity_gb': 1775.6408653259277, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89145) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 11:09:21 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4c99cb00-cef8-465c-9267-86ad01ca423e 1073741824" returned: 0 in 0.542s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4c99cb00-cef8-465c-9267-86ad01ca423e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:21 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4c99cb00-cef8-465c-9267-86ad01ca423e Jul 31 11:09:21 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:21 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53" returned: 0 in 0.404s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:21 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53 Jul 31 11:09:21 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:21 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4c99cb00-cef8-465c-9267-86ad01ca423e" returned: 0 in 0.281s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.865s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b5a3a3-5ef7-4857-94f3-3eeee5af3d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b16fd2f7d249f183d4ad02498d30b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:18Z,use_quota=True,user_id='9b1645e9c9af4235b7f80edf01b389d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Creating volume 76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:09:21 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:21 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 1073741824 Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31684327-d0e1-4880-990c-fe5c6688386c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c99cb00-cef8-465c-9267-86ad01ca423e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:21 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ae513d-bb15-4f05-ae85-849d20364fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:21 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Volume volume-4c99cb00-cef8-465c-9267-86ad01ca423e (4c99cb00-cef8-465c-9267-86ad01ca423e): created successfully Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ae513d-bb15-4f05-ae85-849d20364fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Flow 'volume_create_manager' (4b237db7-1a55-4355-847a-826841541f13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:21 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-1a0022ce-2d94-4e46-812c-02794309a911 tempest-ProjectReaderTests-1912018956 None] Created volume successfully. Jul 31 11:09:21 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e21dec2-bf23-4acc-9905-ee0ea036ab53" returned: 0 in 0.283s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Lock "cinder-quobyte-3e21dec2-bf23-4acc-9905-ee0ea036ab53" released by "delete_volume" :: held 0.738s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:21 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Created reservations ['58c16f7d-b51c-465b-8641-61deb6c7f6d7', '94cec951-34e4-4df6-a814-4352a9878247', '553c9c9f-81df-4b06-ba32-2eb35c06f412', '71b3847a-8e81-4a55-923a-bdea009ef1e2'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:22 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:22 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:22 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.269s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:22 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Deleted volume successfully. Jul 31 11:09:22 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 1073741824" returned: 0 in 0.570s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7fe46386-6a7e-44df-9bef-c5a8d6150e1c tempest-CinderUnicodeTest-667505 None] Lock "cinder-3e21dec2-bf23-4acc-9905-ee0ea036ab53-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:22 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 Jul 31 11:09:22 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:22 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26" returned: 0 in 0.296s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Attempting download of b6ac3832-c578-4886-b5b2-5866923901d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/b6ac3832-c578-4886-b5b2-5866923901d4', 'metadata': {}}])) to volume 76b5a3a3-5ef7-4857-94f3-3eeee5af3d26. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[0006cd69-77e6-4249-9645-9bc698601137]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6ac3832-c578-4886-b5b2-5866923901d4_ax12it28 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:22 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6ac3832-c578-4886-b5b2-5866923901d4_ax12it28 Jul 31 11:09:22 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Acquiring lock "cinder-4c99cb00-cef8-465c-9267-86ad01ca423e-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Lock "cinder-4c99cb00-cef8-465c-9267-86ad01ca423e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:23 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6ac3832-c578-4886-b5b2-5866923901d4_ax12it28" returned: 0 in 0.464s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6ac3832-c578-4886-b5b2-5866923901d4_ax12it28 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:23 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6ac3832-c578-4886-b5b2-5866923901d4_ax12it28 Jul 31 11:09:23 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Acquiring lock "cinder-quobyte-4c99cb00-cef8-465c-9267-86ad01ca423e" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Lock "cinder-quobyte-4c99cb00-cef8-465c-9267-86ad01ca423e" acquired by "delete_volume" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a25514-0895-4284-8918-7fa4bcb08c5a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4c99cb00-cef8-465c-9267-86ad01ca423e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:23 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4c99cb00-cef8-465c-9267-86ad01ca423e Jul 31 11:09:23 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:23 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6ac3832-c578-4886-b5b2-5866923901d4_ax12it28" returned: 1 in 0.365s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6ac3832-c578-4886-b5b2-5866923901d4_ax12it28' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[433cc111-4748-44a0-a3be-6269e5254223]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:23 devstack sudo[109335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD Jul 31 11:09:23 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:23 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4c99cb00-cef8-465c-9267-86ad01ca423e" returned: 0 in 0.463s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4c99cb00-cef8-465c-9267-86ad01ca423e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:23 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4c99cb00-cef8-465c-9267-86ad01ca423e Jul 31 11:09:23 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:24 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD" returned: 0 in 0.412s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:24 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD Jul 31 11:09:24 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:24 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-4c99cb00-cef8-465c-9267-86ad01ca423e" returned: 0 in 0.310s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Lock "cinder-quobyte-4c99cb00-cef8-465c-9267-86ad01ca423e" released by "delete_volume" :: held 0.838s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Created reservations ['0bc6414f-4492-4422-8130-748901ff12be', '8a9e7ed4-1fad-4170-a9ad-06278294b5f5', '05808332-771e-466a-895f-09464ec3beaf', '0208c0c7-e961-45a0-949e-c91b059efd0f'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:24 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:24 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:24 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD" returned: 1 in 0.513s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] b6ac3832-c578-4886-b5b2-5866923901d4 was raw, converting to raw {{(pid=89145) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:24 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 Jul 31 11:09:24 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:24 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.287s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:24 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Deleted volume successfully. Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-432355d9-8ba2-4afb-a4fa-54f6383cce61 tempest-ProjectReaderTests-1912018956 None] Lock "cinder-4c99cb00-cef8-465c-9267-86ad01ca423e-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:24 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26" returned: 0 in 0.374s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b6ac3832-c578-4886-b5b2-5866923901d4_w_1xopm_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:09:24 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 11:09:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:24 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 1G Jul 31 11:09:24 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:25 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 1G" returned: 0 in 0.328s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:25 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9309345-98e9-4785-8e68-82d5ff6ca44d]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:25 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 Jul 31 11:09:25 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:25 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26" returned: 0 in 0.455s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:25 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 Jul 31 11:09:25 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:26 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26" returned: 1 in 0.421s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Downloaded image b6ac3832-c578-4886-b5b2-5866923901d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/b6ac3832-c578-4886-b5b2-5866923901d4', 'metadata': {}}])) to volume 76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 successfully. {{(pid=89145) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Temporary image b6ac3832-c578-4886-b5b2-5866923901d4 for user 9b1645e9c9af4235b7f80edf01b389d5 is deleted. {{(pid=89145) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.volume_utils [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Marking volume 76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 as bootable. {{(pid=89145) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Copying metadata from image b6ac3832-c578-4886-b5b2-5866923901d4 to 76b5a3a3-5ef7-4857-94f3-3eeee5af3d26. {{(pid=89145) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Creating volume glance metadata for volume 76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 backed by image b6ac3832-c578-4886-b5b2-5866923901d4 with: {'image_id': 'b6ac3832-c578-4886-b5b2-5866923901d4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f0b880678c036e6df802949f3a3cb178', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89145) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Flow 'volume_create_manager' (f0df9744-2f83-4dcf-ad49-a440d55f2544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4fca9c-4601-4a6e-9e01-15e312ea996f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4fca9c-4601-4a6e-9e01-15e312ea996f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1357051295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8effe53a-7c86-4e8f-bb7c-ae689bcef3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f0fdf5ecb2402192c07d84fe8a5fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:26Z,use_quota=True,user_id='b4abaccfbc4348319434b4d21496ea69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e04f8a7-6bb3-4078-93ff-38d4bda5e874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e04f8a7-6bb3-4078-93ff-38d4bda5e874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2b4ee0-641c-4788-8e2b-cee4effbfede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2b4ee0-641c-4788-8e2b-cee4effbfede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8effe53a-7c86-4e8f-bb7c-ae689bcef3d9', 'volume_name': 'volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2590cd-78ee-4543-b6e7-6745426ab134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2590cd-78ee-4543-b6e7-6745426ab134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee30a27-8260-47f2-971f-85be61670790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:26 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Volume 8effe53a-7c86-4e8f-bb7c-ae689bcef3d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9', 'volume_size': 1} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1357051295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8effe53a-7c86-4e8f-bb7c-ae689bcef3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f0fdf5ecb2402192c07d84fe8a5fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:26Z,use_quota=True,user_id='b4abaccfbc4348319434b4d21496ea69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Creating volume 8effe53a-7c86-4e8f-bb7c-ae689bcef3d9 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:09:26 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:26 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9 1073741824 Jul 31 11:09:26 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2bffc5-2e5c-4802-8389-e6aa19336de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26', 'volume_size': 1, 'image_id': 'b6ac3832-c578-4886-b5b2-5866923901d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6ac3832-c578-4886-b5b2-5866923901d4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f0b880678c036e6df802949f3a3cb178', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2b16fd2f7d249f183d4ad02498d30b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e32432d4e6a38989310d6725af136c6d5ef354abcb092154f56655a06e0c321b5a4f74f63a7bf06c4f2da556b14b18fc73ba9dbe2ae065dba7fcf96a39ba83a', 'id': 'b6ac3832-c578-4886-b5b2-5866923901d4', 'created_at': datetime.datetime(2026, 7, 31, 9, 9, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 9, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6ac3832-c578-4886-b5b2-5866923901d4/file', 'properties': {}}, 'image_service': }' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf32c15-68ed-49b9-b2dc-33e0dcb072d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:26 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Volume volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 (76b5a3a3-5ef7-4857-94f3-3eeee5af3d26): created successfully Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf32c15-68ed-49b9-b2dc-33e0dcb072d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Flow 'volume_create_manager' (8adf200c-0843-441f-8089-0292d4bd91a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:26 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f0240ab6-ec98-4bb9-9ec9-8a6dff28416a tempest-VolumeImageDependencyTests-272942088 None] Created volume successfully. Jul 31 11:09:26 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9 1073741824" returned: 0 in 0.452s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=205,cinder:UPDATE=282,cinder:DELETE=23,cinder:INSERT=78 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:09:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:26 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9 Jul 31 11:09:26 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Acquiring lock "cinder-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Lock "cinder-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=205,cinder:UPDATE=280,cinder:INSERT=72,cinder:DELETE=27 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:09:27 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9" returned: 0 in 0.341s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee30a27-8260-47f2-971f-85be61670790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8917d3ec-e43a-4a95-8850-11ed4ce7c64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Acquiring lock "cinder-quobyte-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:27 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Volume volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9 (8effe53a-7c86-4e8f-bb7c-ae689bcef3d9): created successfully Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8917d3ec-e43a-4a95-8850-11ed4ce7c64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Flow 'volume_create_manager' (f0df9744-2f83-4dcf-ad49-a440d55f2544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Lock "cinder-quobyte-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26" acquired by "delete_volume" :: waited 0.031s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:27 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-16285d1b-1b28-420a-ad1b-5ff17638cf57 tempest-ProjectReaderTests-1912018956 None] Created volume successfully. Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a838a79d-4935-49c3-98b5-56bfbddd66f2]: (4, 'raw') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:27 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 Jul 31 11:09:27 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:27 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26" returned: 0 in 0.413s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:27 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 Jul 31 11:09:27 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Acquiring lock "cinder-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:28 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26" returned: 1 in 0.500s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26' failed. Not Retrying. {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Lock "cinder-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:28 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26 Jul 31 11:09:28 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Acquiring lock "cinder-quobyte-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Lock "cinder-quobyte-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[90efbbae-9250-475b-8523-6e8750b0aa30]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:28 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9 Jul 31 11:09:28 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:28 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26" returned: 0 in 0.347s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Lock "cinder-quobyte-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26" released by "delete_volume" :: held 1.334s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Created reservations ['0c104a83-a272-4a3c-bb9d-7c25be9cb878', '8d38414b-4dd0-4869-981c-a317d07c090f', '2a2ee5e8-1102-47f6-ba77-9677d3b0cd1f', '4a1fbcc7-d2be-4cf7-8926-c7976d44db3b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:28 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:28 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:28 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9" returned: 0 in 0.446s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:28 devstack sudo[109401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9 Jul 31 11:09:28 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:29 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.262s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Deleted volume successfully. Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e3e9de90-ea95-4969-bebd-6d6b9d64b747 tempest-VolumeImageDependencyTests-272942088 None] Lock "cinder-76b5a3a3-5ef7-4857-94f3-3eeee5af3d26-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:29 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9" returned: 0 in 0.282s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Lock "cinder-quobyte-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9" released by "delete_volume" :: held 0.772s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Created reservations ['a3e4b0ff-c5a8-4fd4-a962-0219124a93de', '3fa6dc09-f18d-4e15-b2c1-14bb721cf288', '3e9f635a-e1fd-457f-a0df-721c06ea6bdf', '31101346-8d8c-454b-9b93-dc8ebeb2720e'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:29 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:29 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:29 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.448s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Deleted volume successfully. Jul 31 11:09:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-74926fa3-a3fc-475d-8292-2a457913efc6 tempest-ProjectReaderTests-1912018956 None] Lock "cinder-8effe53a-7c86-4e8f-bb7c-ae689bcef3d9-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (ef028594-211b-4dfb-b4c9-5df96141797d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ec3a0b-fa4f-4ab9-a193-3bf14c19ca09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ec3a0b-fa4f-4ab9-a193-3bf14c19ca09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466299151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f36610-f859-49b6-9501-c1be986e25d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:33Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b950ee-37b1-4cb6-a8e0-b1741b06918f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b950ee-37b1-4cb6-a8e0-b1741b06918f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4704ba1-65a5-468f-a2e4-1177ddf614ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4704ba1-65a5-468f-a2e4-1177ddf614ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f36610-f859-49b6-9501-c1be986e25d7', 'volume_name': 'volume-97f36610-f859-49b6-9501-c1be986e25d7', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d3d7de-ca50-4d2d-8196-e5c8088ac84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d3d7de-ca50-4d2d-8196-e5c8088ac84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e919aa-dc6f-4cf4-9b94-9beaaafbb28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:33 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Volume 97f36610-f859-49b6-9501-c1be986e25d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f36610-f859-49b6-9501-c1be986e25d7', 'volume_size': 1} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466299151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f36610-f859-49b6-9501-c1be986e25d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:33Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Creating volume 97f36610-f859-49b6-9501-c1be986e25d7 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:09:33 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:33 devstack sudo[109408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 1073741824 Jul 31 11:09:33 devstack sudo[109408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:33 devstack sudo[109408]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 1073741824" returned: 0 in 0.505s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:33 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 Jul 31 11:09:33 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:34 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7" returned: 0 in 0.333s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:09:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e919aa-dc6f-4cf4-9b94-9beaaafbb28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f36610-f859-49b6-9501-c1be986e25d7', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1e575c-4748-48cf-b76f-b13635babbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:34 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Volume volume-97f36610-f859-49b6-9501-c1be986e25d7 (97f36610-f859-49b6-9501-c1be986e25d7): created successfully Jul 31 11:09:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1e575c-4748-48cf-b76f-b13635babbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (ef028594-211b-4dfb-b4c9-5df96141797d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:34 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a2226f01-1ff4-4ae4-a3ab-627e154017bb tempest-ProjectMemberTests-160500168 None] Created volume successfully. Jul 31 11:09:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] Creating offline snapshot 605488b9-2197-45ad-b481-89129d73f7aa of volume 97f36610-f859-49b6-9501-c1be986e25d7 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:09:36 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2114d701-4fd9-43f4-a179-34f6b63b2746]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:36 devstack sudo[109454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 Jul 31 11:09:36 devstack sudo[109454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:36 devstack sudo[109454]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7" returned: 0 in 0.465s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:36 devstack sudo[109459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa 1G Jul 31 11:09:36 devstack sudo[109459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:37 devstack sudo[109459]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa 1G" returned: 0 in 0.638s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f36610-f859-49b6-9501-c1be986e25d7 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:37 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f36610-f859-49b6-9501-c1be986e25d7 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa Jul 31 11:09:37 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:37 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f36610-f859-49b6-9501-c1be986e25d7 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa" returned: 0 in 0.395s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:37 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa is being set with open permissions: ugo+rw Jul 31 11:09:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:37 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa Jul 31 11:09:37 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:38 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa" returned: 0 in 0.386s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:38 devstack sudo[109473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.info Jul 31 11:09:38 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:38 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.info" returned: 0 in 0.322s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:38 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.info is being set with open permissions: ugo+rw Jul 31 11:09:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:38 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.info Jul 31 11:09:38 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:38 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.info" returned: 0 in 0.324s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.692s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:39 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8900474c-ded5-43be-ac7d-49d89497847c tempest-ProjectMemberTests-160500168 None] Create snapshot completed successfully Jul 31 11:09:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-605488b9-2197-45ad-b481-89129d73f7aa-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Lock "cinder-605488b9-2197-45ad-b481-89129d73f7aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-97f36610-f859-49b6-9501-c1be986e25d7" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-97f36610-f859-49b6-9501-c1be986e25d7" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-605488b9-2197-45ad-b481-89129d73f7aa" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-605488b9-2197-45ad-b481-89129d73f7aa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Deleting offline snapshot 605488b9-2197-45ad-b481-89129d73f7aa of volume 97f36610-f859-49b6-9501-c1be986e25d7 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:09:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] snapshot_file for this snap is: volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:09:39 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5af239f-75cc-419c-b739-1bfc981d302d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:39 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa Jul 31 11:09:39 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:40 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa" returned: 0 in 0.465s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97f36610-f859-49b6-9501-c1be986e25d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:09:40 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b108b859-42f9-47f6-9412-9c93b70ee68a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:40 devstack sudo[109485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 Jul 31 11:09:40 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:40 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7" returned: 0 in 0.554s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:40 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa Jul 31 11:09:40 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:41 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa" returned: 0 in 0.413s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:41 devstack sudo[109496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa Jul 31 11:09:41 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:41 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7.605488b9-2197-45ad-b481-89129d73f7aa" returned: 0 in 0.438s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-605488b9-2197-45ad-b481-89129d73f7aa" released by "_delete_snapshot" :: held 2.082s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-97f36610-f859-49b6-9501-c1be986e25d7" released by "delete_snapshot" :: held 2.112s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:41 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Created reservations ['2c450c23-e3d7-41ab-a461-4a98be1d6f3f', '2e0f654d-1d01-4fdd-9f98-d99f28bcef4e', '84351f14-3336-4eb1-a175-0f979b5b77d6', 'd72a7a55-ec45-4fe2-9106-87c46f45796b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:41 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Delete snapshot completed successfully. Jul 31 11:09:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-655fdf05-218f-4208-ba99-f6c2c57e776d tempest-ProjectMemberTests-160500168 None] Lock "cinder-605488b9-2197-45ad-b481-89129d73f7aa-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-97f36610-f859-49b6-9501-c1be986e25d7-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Lock "cinder-97f36610-f859-49b6-9501-c1be986e25d7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-97f36610-f859-49b6-9501-c1be986e25d7" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:42 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-97f36610-f859-49b6-9501-c1be986e25d7" acquired by "delete_volume" :: waited 0.024s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:42 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1713b2f-41c7-466f-9070-17026f06b6ed]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:43 devstack sudo[109499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 Jul 31 11:09:43 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:43 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7" returned: 0 in 0.485s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:43 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7 Jul 31 11:09:43 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:43 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97f36610-f859-49b6-9501-c1be986e25d7" returned: 0 in 0.295s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-97f36610-f859-49b6-9501-c1be986e25d7" released by "delete_volume" :: held 0.874s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:43 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Created reservations ['ee03febc-287f-448c-9e3b-0b78e972703d', 'cef7aefd-4c5f-4f45-a418-2edc901a3ab2', '7d52f87b-c474-4836-8b22-7849e2bb7440', 'b9c25d60-99bb-4902-9702-7bb160dcbb73'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:43 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:43 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:43 devstack sudo[109508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:43 devstack sudo[109508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:44 devstack sudo[109508]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.380s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:44 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:44 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Deleted volume successfully. Jul 31 11:09:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4b7f13d4-65ad-4a6a-989e-bf0d206fb75a tempest-ProjectMemberTests-160500168 None] Lock "cinder-97f36610-f859-49b6-9501-c1be986e25d7-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:44 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:09:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (f422d0e3-834b-45bd-8b4b-01fd43fdf2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59563fb-8811-4d64-b347-86b5c300f26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59563fb-8811-4d64-b347-86b5c300f26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9552078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aaf174c-2fc4-4135-a1dd-d5164afa72a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:45Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72d20a8-0024-4748-a405-798d11d2edae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72d20a8-0024-4748-a405-798d11d2edae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2bc20a-ae56-45d8-8663-59a1d0b8ad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2bc20a-ae56-45d8-8663-59a1d0b8ad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aaf174c-2fc4-4135-a1dd-d5164afa72a5', 'volume_name': 'volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6482ac38-4416-4f72-b87e-2136697ac03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6482ac38-4416-4f72-b87e-2136697ac03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc97ae5-04bf-45c9-b5f4-6e29d854d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:45 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Volume 3aaf174c-2fc4-4135-a1dd-d5164afa72a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5', 'volume_size': 1} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9552078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aaf174c-2fc4-4135-a1dd-d5164afa72a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:45Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Creating volume 3aaf174c-2fc4-4135-a1dd-d5164afa72a5 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:09:45 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:45 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 1073741824 Jul 31 11:09:45 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:45 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 1073741824" returned: 0 in 0.682s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:45 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 Jul 31 11:09:45 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:46 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5" returned: 0 in 0.289s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:46 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:09:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc97ae5-04bf-45c9-b5f4-6e29d854d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eeb203c-6374-495a-95aa-b6406e728724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:46 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Volume volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 (3aaf174c-2fc4-4135-a1dd-d5164afa72a5): created successfully Jul 31 11:09:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eeb203c-6374-495a-95aa-b6406e728724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:46 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (f422d0e3-834b-45bd-8b4b-01fd43fdf2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:46 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4b105bdf-661e-4965-b05f-6d142b385852 tempest-ProjectMemberTests-160500168 None] Created volume successfully. Jul 31 11:09:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] Creating offline snapshot 52d50cf6-26cd-4a41-bdd0-955b4e945949 of volume 3aaf174c-2fc4-4135-a1dd-d5164afa72a5 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:09:47 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae8889-e476-4a85-8acc-98e9a7f14821]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:47 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 Jul 31 11:09:47 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:47 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5" returned: 0 in 0.438s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:47 devstack sudo[109532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 1G Jul 31 11:09:47 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:48 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 1G" returned: 0 in 0.471s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:48 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 Jul 31 11:09:48 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:48 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949" returned: 0 in 0.347s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:48 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 is being set with open permissions: ugo+rw Jul 31 11:09:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:48 devstack sudo[109543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 Jul 31 11:09:48 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:48 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949" returned: 0 in 0.343s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:49 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.info Jul 31 11:09:49 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:49 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.info" returned: 0 in 0.287s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:49 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.info is being set with open permissions: ugo+rw Jul 31 11:09:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:49 devstack sudo[109551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.info Jul 31 11:09:49 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:49 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.info" returned: 0 in 0.272s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:49 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7cefe646-08ea-49d2-bbef-c63b767c1a00 tempest-ProjectMemberTests-160500168 None] Create snapshot completed successfully Jul 31 11:09:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-52d50cf6-26cd-4a41-bdd0-955b4e945949-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Lock "cinder-52d50cf6-26cd-4a41-bdd0-955b4e945949-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-3aaf174c-2fc4-4135-a1dd-d5164afa72a5" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-3aaf174c-2fc4-4135-a1dd-d5164afa72a5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-52d50cf6-26cd-4a41-bdd0-955b4e945949" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:50 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-52d50cf6-26cd-4a41-bdd0-955b4e945949" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Deleting offline snapshot 52d50cf6-26cd-4a41-bdd0-955b4e945949 of volume 3aaf174c-2fc4-4135-a1dd-d5164afa72a5 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:09:50 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] snapshot_file for this snap is: volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:09:50 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d87fa94-a0ff-445e-aba2-77f1f4705cf8]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:50 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 Jul 31 11:09:50 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:51 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949" returned: 0 in 0.457s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:09:51 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37acee5-adb2-4b1e-93cb-78e2391d9a6c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:51 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 Jul 31 11:09:51 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:51 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5" returned: 0 in 0.447s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:51 devstack sudo[109566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 Jul 31 11:09:51 devstack sudo[109566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:51 devstack sudo[109566]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949" returned: 0 in 0.407s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:51 devstack sudo[109571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949 Jul 31 11:09:51 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:52 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5.52d50cf6-26cd-4a41-bdd0-955b4e945949" returned: 0 in 0.299s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-52d50cf6-26cd-4a41-bdd0-955b4e945949" released by "_delete_snapshot" :: held 1.763s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-3aaf174c-2fc4-4135-a1dd-d5164afa72a5" released by "delete_snapshot" :: held 1.792s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:52 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Created reservations ['c07daaa6-613e-4da4-9828-f50f23a0d61e', 'f84e2e07-bea0-49a1-a31c-303761f19b41', 'e12861be-b499-4137-9c89-cc6b365a4ef7', '33e044a7-75e9-43c4-8ce5-14396757212e'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Delete snapshot completed successfully. Jul 31 11:09:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6e48e6cf-fd95-432e-82af-674f4aa11217 tempest-ProjectMemberTests-160500168 None] Lock "cinder-52d50cf6-26cd-4a41-bdd0-955b4e945949-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-3aaf174c-2fc4-4135-a1dd-d5164afa72a5-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Lock "cinder-3aaf174c-2fc4-4135-a1dd-d5164afa72a5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-3aaf174c-2fc4-4135-a1dd-d5164afa72a5" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-3aaf174c-2fc4-4135-a1dd-d5164afa72a5" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:52 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9bb3fe-6b78-4693-82d7-90e20d0ca9d5]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:52 devstack sudo[109574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 Jul 31 11:09:52 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:53 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5" returned: 0 in 0.408s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:53 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5 Jul 31 11:09:53 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:53 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3aaf174c-2fc4-4135-a1dd-d5164afa72a5" returned: 0 in 0.335s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-3aaf174c-2fc4-4135-a1dd-d5164afa72a5" released by "delete_volume" :: held 0.832s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:53 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Created reservations ['6746ae4b-f9fd-400c-a3b5-4e758b7366fd', '62968240-b6ae-4208-99f8-54ba30e48805', 'e3353d17-422e-4629-8a9e-9e0177fdecb1', '4fe6a111-5e32-4766-b9a5-a71557c0bd98'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:09:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:53 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:53 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:09:53 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:54 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.336s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:54 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Deleted volume successfully. Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-ebd2a5e0-a526-449d-b915-a34a3f4fca6e tempest-ProjectMemberTests-160500168 None] Lock "cinder-3aaf174c-2fc4-4135-a1dd-d5164afa72a5-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (05c55225-433f-4a9e-a61e-a355a817c841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b95506-6b21-46c9-9d26-ece3e8db4dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b95506-6b21-46c9-9d26-ece3e8db4dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138568575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9cf499-c3b0-4f33-b416-f884e6e1c4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:54Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ee6894-da8e-48d9-a0e2-40d957695d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ee6894-da8e-48d9-a0e2-40d957695d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa051a9-36f1-4645-9631-386029d64169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa051a9-36f1-4645-9631-386029d64169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc9cf499-c3b0-4f33-b416-f884e6e1c4fb', 'volume_name': 'volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93300a36-e50f-46c1-bf86-41e036eabc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93300a36-e50f-46c1-bf86-41e036eabc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a83bf0d-1214-4e22-ac05-2167e55f6b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:54 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Volume cc9cf499-c3b0-4f33-b416-f884e6e1c4fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb', 'volume_size': 1} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138568575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9cf499-c3b0-4f33-b416-f884e6e1c4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:54Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Creating volume cc9cf499-c3b0-4f33-b416-f884e6e1c4fb {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:09:54 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:09:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:54 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb 1073741824 Jul 31 11:09:54 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:55 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb 1073741824" returned: 0 in 0.717s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:55 devstack sudo[109592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb Jul 31 11:09:55 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:55 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb" returned: 0 in 0.326s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:55 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:09:55 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a83bf0d-1214-4e22-ac05-2167e55f6b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fc7655-7fef-4190-85b0-fced9758bcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:55 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Volume volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb (cc9cf499-c3b0-4f33-b416-f884e6e1c4fb): created successfully Jul 31 11:09:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fc7655-7fef-4190-85b0-fced9758bcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:55 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (05c55225-433f-4a9e-a61e-a355a817c841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:55 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7d156f59-34a0-46dd-b6e9-078e6ce2773a tempest-ProjectMemberTests-160500168 None] Created volume successfully. Jul 31 11:09:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:56 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] Creating offline snapshot bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 of volume cc9cf499-c3b0-4f33-b416-f884e6e1c4fb {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:09:56 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fc83d5-66f0-4ec1-9927-187ffe2e3bc5]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:56 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:56 devstack sudo[109595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb Jul 31 11:09:56 devstack sudo[109595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:57 devstack sudo[109595]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb" returned: 0 in 0.432s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:57 devstack sudo[109600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 1G Jul 31 11:09:57 devstack sudo[109600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:57 devstack sudo[109600]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 1G" returned: 0 in 0.565s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:57 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:57 devstack sudo[109605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 Jul 31 11:09:57 devstack sudo[109605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:58 devstack sudo[109605]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358" returned: 0 in 0.432s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:58 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 is being set with open permissions: ugo+rw Jul 31 11:09:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:58 devstack sudo[109610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 Jul 31 11:09:58 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:58 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358" returned: 0 in 0.453s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:58 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.info Jul 31 11:09:58 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:59 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.info" returned: 0 in 0.262s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:59 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.info is being set with open permissions: ugo+rw Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:59 devstack sudo[109616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.info Jul 31 11:09:59 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:59 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.info" returned: 0 in 0.270s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:59 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-a8884635-445f-4c02-8d9a-dec4dd6496f0 tempest-ProjectMemberTests-160500168 None] Create snapshot completed successfully Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Flow 'volume_create_manager' (295922e7-cd89-4237-9790-92340f5e80b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c61e2fc-f3c5-4700-b83a-7f136eb8f4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c61e2fc-f3c5-4700-b83a-7f136eb8f4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-256817556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0d74be-33c0-4847-ad97-65e9f82451c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03b0c9fb89545e5b805628c36d682cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:00Z,use_quota=True,user_id='98a9b2779bee4552b013d49db0eeeca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2578c203-489f-41c2-980f-1c95747c4b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2578c203-489f-41c2-980f-1c95747c4b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7591b1-8dac-4cc5-a625-9266c4396237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7591b1-8dac-4cc5-a625-9266c4396237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0d74be-33c0-4847-ad97-65e9f82451c7', 'volume_name': 'volume-8a0d74be-33c0-4847-ad97-65e9f82451c7', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2497343d-d63c-4f0e-9cc6-839f5726090f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2497343d-d63c-4f0e-9cc6-839f5726090f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e71b83-62b8-4d52-9510-321d77b83d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:59 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Volume 8a0d74be-33c0-4847-ad97-65e9f82451c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0d74be-33c0-4847-ad97-65e9f82451c7', 'volume_size': 1} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-256817556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0d74be-33c0-4847-ad97-65e9f82451c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03b0c9fb89545e5b805628c36d682cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:00Z,use_quota=True,user_id='98a9b2779bee4552b013d49db0eeeca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Creating volume 8a0d74be-33c0-4847-ad97-65e9f82451c7 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:09:59 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:09:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:59 devstack sudo[109619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 1073741824 Jul 31 11:09:59 devstack sudo[109619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-bdb4fcb7-8b9d-4865-ad19-dbd4e0211358-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Lock "cinder-bdb4fcb7-8b9d-4865-ad19-dbd4e0211358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-bdb4fcb7-8b9d-4865-ad19-dbd4e0211358" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-bdb4fcb7-8b9d-4865-ad19-dbd4e0211358" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Deleting offline snapshot bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 of volume cc9cf499-c3b0-4f33-b416-f884e6e1c4fb {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] snapshot_file for this snap is: volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[db296742-41da-45ac-9cda-35c2cea19b4c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:00 devstack sudo[109624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 Jul 31 11:10:00 devstack sudo[109624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:00 devstack sudo[109619]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 1073741824" returned: 0 in 0.463s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:00 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 Jul 31 11:10:00 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:00 devstack sudo[109624]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358" returned: 0 in 0.380s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0be9af-afaa-4b2a-8f27-03dae7fdae41]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:00 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7" returned: 0 in 0.257s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e71b83-62b8-4d52-9510-321d77b83d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0d74be-33c0-4847-ad97-65e9f82451c7', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38ce805-f88e-4155-a2e4-b48be4911c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:00 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Volume volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 (8a0d74be-33c0-4847-ad97-65e9f82451c7): created successfully Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38ce805-f88e-4155-a2e4-b48be4911c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:00 devstack sudo[109633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb Jul 31 11:10:00 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Flow 'volume_create_manager' (295922e7-cd89-4237-9790-92340f5e80b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:00 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f89d0a5e-ac35-4f02-9426-f448979e5476 tempest-SnapshotDependencyTests-1418277915 None] Created volume successfully. Jul 31 11:10:00 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb" returned: 0 in 0.383s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:00 devstack sudo[109641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 Jul 31 11:10:00 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:00 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] Creating offline snapshot 0051930f-aa65-481e-b00f-bc30add61f33 of volume 8a0d74be-33c0-4847-ad97-65e9f82451c7 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddb7f04-5c51-405b-ba71-bdcc79941158]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:01 devstack sudo[109643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 Jul 31 11:10:01 devstack sudo[109643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:01 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358" returned: 0 in 0.359s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:01 devstack sudo[109648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358 Jul 31 11:10:01 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:01 devstack sudo[109643]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7" returned: 0 in 0.373s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:01 devstack sudo[109653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 1G Jul 31 11:10:01 devstack sudo[109653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:01 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb.bdb4fcb7-8b9d-4865-ad19-dbd4e0211358" returned: 0 in 0.239s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-bdb4fcb7-8b9d-4865-ad19-dbd4e0211358" released by "_delete_snapshot" :: held 1.450s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb" released by "delete_snapshot" :: held 1.472s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Created reservations ['68d331ce-00e6-4b5a-867f-95ebb35940d6', 'ca152789-5f2f-41f6-8ed4-88bffd600273', 'abe46f1c-c68c-4a1b-b023-c98d4ee5074a', '2053584b-e436-41df-aa5b-3d1aed1cff62'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:01 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Delete snapshot completed successfully. Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-fb5eea73-ea02-417f-9e18-1673326b6e9f tempest-ProjectMemberTests-160500168 None] Lock "cinder-bdb4fcb7-8b9d-4865-ad19-dbd4e0211358-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:01 devstack sudo[109653]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 1G" returned: 0 in 0.410s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:01 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 Jul 31 11:10:01 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:02 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33" returned: 0 in 0.294s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:02 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 is being set with open permissions: ugo+rw Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:02 devstack sudo[109664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 Jul 31 11:10:02 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Lock "cinder-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4512d8e-53b7-412b-937d-55b86a7425c9]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:02 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33" returned: 0 in 0.255s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:02 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.info Jul 31 11:10:02 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:02 devstack sudo[109667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb Jul 31 11:10:02 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:02 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.info" returned: 0 in 0.276s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:02 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.info is being set with open permissions: ugo+rw Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:02 devstack sudo[109675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.info Jul 31 11:10:02 devstack sudo[109675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:02 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb" returned: 0 in 0.376s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:02 devstack sudo[109677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb Jul 31 11:10:02 devstack sudo[109677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:02 devstack sudo[109675]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.info" returned: 0 in 0.257s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:02 devstack sudo[109677]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb" returned: 0 in 0.252s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb" released by "delete_volume" :: held 0.694s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:03 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-68916478-cdae-429c-8176-3af95f268be3 tempest-SnapshotDependencyTests-1418277915 None] Create snapshot completed successfully Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Created reservations ['ee34fb61-2fa4-4e31-93df-ea865c850bbe', 'dfd1afa2-6e6c-4156-811b-fcf4a25f9e60', '9e6bf9f0-db5a-4947-ac5f-24ca9d38bada', 'a31a6755-1fdb-442f-9ad0-44ce68563a2c'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:03 devstack sudo[109681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:10:03 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:03 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.263s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:03 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Deleted volume successfully. Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-98aff5ee-6280-415f-b11e-5415721a7cf1 tempest-ProjectMemberTests-160500168 None] Lock "cinder-cc9cf499-c3b0-4f33-b416-f884e6e1c4fb-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (2358c132-2250-44af-822d-ad0f1a9ecf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3b7c7b-6113-4227-ba34-fb762b2ed2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3b7c7b-6113-4227-ba34-fb762b2ed2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-894884717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e502519-351f-4990-9a2d-0d2fa738078c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:04Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe394513-f904-4e0a-94a1-d4fd1ae55fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe394513-f904-4e0a-94a1-d4fd1ae55fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0096175b-2db7-41a4-9fad-bd33585e96b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0096175b-2db7-41a4-9fad-bd33585e96b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e502519-351f-4990-9a2d-0d2fa738078c', 'volume_name': 'volume-3e502519-351f-4990-9a2d-0d2fa738078c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7403d7b2-00fe-4627-8dd5-64780e2b4def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7403d7b2-00fe-4627-8dd5-64780e2b4def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ced683-4375-4544-baf5-ddc18c59c61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:03 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Volume 3e502519-351f-4990-9a2d-0d2fa738078c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e502519-351f-4990-9a2d-0d2fa738078c', 'volume_size': 1} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-894884717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e502519-351f-4990-9a2d-0d2fa738078c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:04Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Creating volume 3e502519-351f-4990-9a2d-0d2fa738078c {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:03 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:10:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:03 devstack sudo[109685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c 1073741824 Jul 31 11:10:03 devstack sudo[109685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:04 devstack sudo[109685]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c 1073741824" returned: 0 in 0.438s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:04 devstack sudo[109690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c Jul 31 11:10:04 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:04 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c" returned: 0 in 0.273s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ced683-4375-4544-baf5-ddc18c59c61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e502519-351f-4990-9a2d-0d2fa738078c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19865fc4-7323-4c4a-9ada-26162a959198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:04 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Volume volume-3e502519-351f-4990-9a2d-0d2fa738078c (3e502519-351f-4990-9a2d-0d2fa738078c): created successfully Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19865fc4-7323-4c4a-9ada-26162a959198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (2358c132-2250-44af-822d-ad0f1a9ecf4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Flow 'volume_create_manager' (d07c775f-c77f-4209-aae5-4cf154f3b6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1953a09c-d3e1-4c1b-87d3-04f1d771412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:04 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2fef5078-f9c4-487d-acb0-ceb59270184b tempest-ProjectMemberTests-160500168 None] Created volume successfully. Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1953a09c-d3e1-4c1b-87d3-04f1d771412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81112f36-1717-401e-9558-b3f0db19c06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03b0c9fb89545e5b805628c36d682cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0051930f-aa65-481e-b00f-bc30add61f33,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:05Z,use_quota=True,user_id='98a9b2779bee4552b013d49db0eeeca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9d604c-49b1-48ca-8988-34505e36e5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9d604c-49b1-48ca-8988-34505e36e5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f78d2bd-c4a4-4832-90aa-658c04348222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f78d2bd-c4a4-4832-90aa-658c04348222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '81112f36-1717-401e-9558-b3f0db19c06a', 'volume_name': 'volume-81112f36-1717-401e-9558-b3f0db19c06a', 'volume_size': 1, 'snapshot_id': '0051930f-aa65-481e-b00f-bc30add61f33'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32629fd8-c516-4871-ac30-ad8fffce0b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32629fd8-c516-4871-ac30-ad8fffce0b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6767c630-5b52-4ef1-980d-cdf9c266c6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:04 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Volume 81112f36-1717-401e-9558-b3f0db19c06a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-81112f36-1717-401e-9558-b3f0db19c06a', 'volume_size': 1, 'snapshot_id': '0051930f-aa65-481e-b00f-bc30add61f33'} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "cinder-quobyte-0051930f-aa65-481e-b00f-bc30add61f33-81112f36-1717-401e-9558-b3f0db19c06a" by "_create_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-quobyte-0051930f-aa65-481e-b00f-bc30add61f33-81112f36-1717-401e-9558-b3f0db19c06a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Creating volume 81112f36-1717-401e-9558-b3f0db19c06a from snapshot 0051930f-aa65-481e-b00f-bc30add61f33 {{(pid=89145) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "cinder-quobyte-81112f36-1717-401e-9558-b3f0db19c06a" by "_copy_volume_from_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-quobyte-81112f36-1717-401e-9558-b3f0db19c06a" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] snapshot: 0051930f-aa65-481e-b00f-bc30add61f33, volume: 81112f36-1717-401e-9558-b3f0db19c06a, {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d5f500-b6a9-4d12-b2df-e88bc6c2e8d8]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:05 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 Jul 31 11:10:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:05 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:05 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33" returned: 0 in 0.411s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a0d74be-33c0-4847-ad97-65e9f82451c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:10:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:10:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Creating direct copy from snapshot {{(pid=89145) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:10:05 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4249b4-3850-4bb8-a41e-8ed6db3fa88d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:05 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 Jul 31 11:10:05 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:05 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7" returned: 0 in 0.395s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:05 devstack cinder-volume[89145]: DEBUG cinder.utils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Path /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a not found in is_blk_device check {{(pid=89145) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:10:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:05 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a Jul 31 11:10:05 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:10:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:08 devstack sudo[109718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:10:08 devstack sudo[109718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:08 devstack sudo[109718]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.510s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:10:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:10:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:10:09 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a" returned: 0 in 3.947s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:09 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[30670800-3544-4664-8ccf-1fc696de7634]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:09 devstack sudo[109721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 Jul 31 11:10:09 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:10 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7" returned: 0 in 0.513s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG cinder.image.image_utils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Image conversion details: src /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7, size 1024.00 MB, duration 3.95 sec, destination /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a {{(pid=89145) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:10:10 devstack cinder-volume[89145]: INFO cinder.image.image_utils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Converted 1024.00 MB image at 259.33 MB/s Jul 31 11:10:10 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a is being set with open permissions: ugo+rw Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:10 devstack sudo[109726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a Jul 31 11:10:10 devstack sudo[109726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:10 devstack sudo[109726]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a" returned: 0 in 0.225s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-quobyte-81112f36-1717-401e-9558-b3f0db19c06a" released by "_copy_volume_from_snapshot" :: held 5.590s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-quobyte-0051930f-aa65-481e-b00f-bc30add61f33-81112f36-1717-401e-9558-b3f0db19c06a" released by "_create_volume_from_snapshot" :: held 5.631s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.648s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.432s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] Creating offline snapshot d21adc8f-55d1-400a-acd3-ca6a6653b117 of volume 3e502519-351f-4990-9a2d-0d2fa738078c {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6767c630-5b52-4ef1-980d-cdf9c266c6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81112f36-1717-401e-9558-b3f0db19c06a', 'volume_size': 1, 'snapshot_id': '0051930f-aa65-481e-b00f-bc30add61f33'}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15703eb8-ce61-45a0-bcd1-b41033142d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d65f5f-c80a-4864-86da-16a8f416b45c]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:10 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Volume volume-81112f36-1717-401e-9558-b3f0db19c06a (81112f36-1717-401e-9558-b3f0db19c06a): created successfully Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15703eb8-ce61-45a0-bcd1-b41033142d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Flow 'volume_create_manager' (d07c775f-c77f-4209-aae5-4cf154f3b6e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-611bc3bf-4668-4ea7-99f7-3344d68bc94f tempest-SnapshotDependencyTests-1418277915 None] Created volume successfully. Jul 31 11:10:10 devstack sudo[109729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c Jul 31 11:10:10 devstack sudo[109729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:10 devstack sudo[109729]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c" returned: 0 in 0.362s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:10 devstack sudo[109734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 1G Jul 31 11:10:10 devstack sudo[109734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "cinder-0051930f-aa65-481e-b00f-bc30add61f33-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:11 devstack sudo[109734]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 1G" returned: 0 in 0.414s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e502519-351f-4990-9a2d-0d2fa738078c -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-0051930f-aa65-481e-b00f-bc30add61f33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "cinder-quobyte-8a0d74be-33c0-4847-ad97-65e9f82451c7" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:11 devstack sudo[109740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e502519-351f-4990-9a2d-0d2fa738078c -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 Jul 31 11:10:11 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-quobyte-8a0d74be-33c0-4847-ad97-65e9f82451c7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "cinder-quobyte-0051930f-aa65-481e-b00f-bc30add61f33" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-quobyte-0051930f-aa65-481e-b00f-bc30add61f33" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Deleting offline snapshot 0051930f-aa65-481e-b00f-bc30add61f33 of volume 8a0d74be-33c0-4847-ad97-65e9f82451c7 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] snapshot_file for this snap is: volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b377f5d5-0a28-4701-907a-17772f8c4791]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:11 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 Jul 31 11:10:11 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:11 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e502519-351f-4990-9a2d-0d2fa738078c -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117" returned: 0 in 0.287s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:11 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 is being set with open permissions: ugo+rw Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:11 devstack sudo[109747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 Jul 31 11:10:11 devstack sudo[109747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:11 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33" returned: 0 in 0.375s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a0d74be-33c0-4847-ad97-65e9f82451c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e943c46-4bd5-42d3-b11b-606e43b51c5a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:11 devstack sudo[109747]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117" returned: 0 in 0.243s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:11 devstack sudo[109754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.info Jul 31 11:10:11 devstack sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:11 devstack sudo[109753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 Jul 31 11:10:11 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:12 devstack sudo[109754]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.info" returned: 0 in 0.256s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:12 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.info is being set with open permissions: ugo+rw Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:12 devstack sudo[109761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.info Jul 31 11:10:12 devstack sudo[109761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:12 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7" returned: 0 in 0.371s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:12 devstack sudo[109763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 Jul 31 11:10:12 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:12 devstack sudo[109761]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.info" returned: 0 in 0.251s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:12 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-bda27b72-c8db-4bb8-8f50-17067f49f152 tempest-ProjectMemberTests-160500168 None] Create snapshot completed successfully Jul 31 11:10:12 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33" returned: 0 in 0.341s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:12 devstack sudo[109770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33 Jul 31 11:10:12 devstack sudo[109770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:12 devstack sudo[109770]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7.0051930f-aa65-481e-b00f-bc30add61f33" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-quobyte-0051930f-aa65-481e-b00f-bc30add61f33" released by "_delete_snapshot" :: held 1.431s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-quobyte-8a0d74be-33c0-4847-ad97-65e9f82451c7" released by "delete_snapshot" :: held 1.456s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Created reservations ['38cf51cb-b227-4cbb-bc7d-9b1b331d1668', '46680cbe-8b48-4f33-8ca7-16ec34a62a44', '502b431e-eec2-4b33-85b1-c7604261a4ba', 'dac2583b-ced1-406d-afe3-69adfef4cda6'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:12 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Delete snapshot completed successfully. Jul 31 11:10:12 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-54f1972d-d569-4b95-a0ea-f6a077c589e1 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-0051930f-aa65-481e-b00f-bc30add61f33-delete_snapshot" released by "delete_snapshot" :: held 1.590s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-d21adc8f-55d1-400a-acd3-ca6a6653b117-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "cinder-8a0d74be-33c0-4847-ad97-65e9f82451c7-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Lock "cinder-d21adc8f-55d1-400a-acd3-ca6a6653b117-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-3e502519-351f-4990-9a2d-0d2fa738078c" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-8a0d74be-33c0-4847-ad97-65e9f82451c7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-3e502519-351f-4990-9a2d-0d2fa738078c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-d21adc8f-55d1-400a-acd3-ca6a6653b117" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-d21adc8f-55d1-400a-acd3-ca6a6653b117" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Deleting offline snapshot d21adc8f-55d1-400a-acd3-ca6a6653b117 of volume 3e502519-351f-4990-9a2d-0d2fa738078c {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] snapshot_file for this snap is: volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "cinder-quobyte-8a0d74be-33c0-4847-ad97-65e9f82451c7" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[735e1de5-7c22-4250-818c-61ca461327f4]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-quobyte-8a0d74be-33c0-4847-ad97-65e9f82451c7" acquired by "delete_volume" :: waited 0.026s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[d918933e-5a66-444d-8425-4bdc376419a7]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:13 devstack sudo[109773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 Jul 31 11:10:13 devstack sudo[109773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:13 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 Jul 31 11:10:13 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:13 devstack sudo[109773]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117" returned: 0 in 0.370s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e502519-351f-4990-9a2d-0d2fa738078c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8641ec-5fd5-4562-a4b1-4e82c0ea1a1d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:13 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7" returned: 0 in 0.364s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:14 devstack sudo[109785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7 Jul 31 11:10:14 devstack sudo[109785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:14 devstack sudo[109784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c Jul 31 11:10:14 devstack sudo[109784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:14 devstack sudo[109785]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8a0d74be-33c0-4847-ad97-65e9f82451c7" returned: 0 in 0.249s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-quobyte-8a0d74be-33c0-4847-ad97-65e9f82451c7" released by "delete_volume" :: held 0.672s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Created reservations ['79096527-5ac5-4c29-bb49-7f95111a93a0', 'bc56da98-4932-4073-a66d-777682211614', '326b9557-2ab1-4e9a-841d-b199f8356189', '3a6d18ad-9fc3-479c-90e3-d694dc61ff0b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:14 devstack sudo[109784]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c" returned: 0 in 0.374s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:14 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 Jul 31 11:10:14 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:14 devstack sudo[109794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:10:14 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "cinder-81112f36-1717-401e-9558-b3f0db19c06a-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:14 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.265s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-81112f36-1717-401e-9558-b3f0db19c06a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:14 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Deleted volume successfully. Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-94a4f2a0-6df2-4ab7-82ac-f084e7980113 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-8a0d74be-33c0-4847-ad97-65e9f82451c7-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "cinder-quobyte-81112f36-1717-401e-9558-b3f0db19c06a" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-quobyte-81112f36-1717-401e-9558-b3f0db19c06a" acquired by "delete_volume" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:14 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117" returned: 0 in 0.406s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cddc76d-d9f2-4da5-92c4-1c6b655a253d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:14 devstack sudo[109800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117 Jul 31 11:10:14 devstack sudo[109800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:14 devstack sudo[109801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a Jul 31 11:10:14 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:15 devstack sudo[109800]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c.d21adc8f-55d1-400a-acd3-ca6a6653b117" returned: 0 in 0.258s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-d21adc8f-55d1-400a-acd3-ca6a6653b117" released by "_delete_snapshot" :: held 1.507s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-3e502519-351f-4990-9a2d-0d2fa738078c" released by "delete_snapshot" :: held 1.539s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Created reservations ['4b66d496-34c3-4a79-8497-1b2458421fca', '8501ac72-c222-497a-80e4-66dc388baf3a', '153893f3-13a0-41c1-a1d9-b3d1cf27cec2', '09498b9e-5cdb-449c-a9f8-a37c010bb3ee'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:15 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a" returned: 0 in 0.367s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:15 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a Jul 31 11:10:15 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:15 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Delete snapshot completed successfully. Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7b7a46c4-b035-4d8a-ace9-ea032d5fc1f5 tempest-ProjectMemberTests-160500168 None] Lock "cinder-d21adc8f-55d1-400a-acd3-ca6a6653b117-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:15 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-81112f36-1717-401e-9558-b3f0db19c06a" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-quobyte-81112f36-1717-401e-9558-b3f0db19c06a" released by "delete_volume" :: held 0.647s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Created reservations ['c44c2645-d7e1-4bea-a077-4306da47f38e', 'c7245f2b-d209-41f6-bcac-3f5f5965f3bf', '34df74ce-fa52-4ba7-994a-97d4d2b01bf5', '6a3a5e64-0405-400e-add1-4883eac498ff'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:15 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:10:15 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-3e502519-351f-4990-9a2d-0d2fa738078c-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Lock "cinder-3e502519-351f-4990-9a2d-0d2fa738078c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-3e502519-351f-4990-9a2d-0d2fa738078c" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-3e502519-351f-4990-9a2d-0d2fa738078c" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:15 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.281s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[417fad31-61c9-42cb-8b2d-7c452eafd87f]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:15 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Deleted volume successfully. Jul 31 11:10:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-c0cd84bc-9bce-4e2c-a931-f2fffa38ca05 tempest-SnapshotDependencyTests-1418277915 None] Lock "cinder-81112f36-1717-401e-9558-b3f0db19c06a-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:15 devstack sudo[109814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c Jul 31 11:10:15 devstack sudo[109814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:16 devstack sudo[109814]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c" returned: 0 in 0.386s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:16 devstack sudo[109819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c Jul 31 11:10:16 devstack sudo[109819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:16 devstack sudo[109819]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-3e502519-351f-4990-9a2d-0d2fa738078c" returned: 0 in 0.285s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-3e502519-351f-4990-9a2d-0d2fa738078c" released by "delete_volume" :: held 0.760s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Created reservations ['1b9de350-fd7c-4e6f-bdee-254f7da5a740', 'f9ad73e7-1e1e-4cc1-8e37-b8569c6457c6', 'd0762ae5-870d-4e9d-ae9e-4f6d73d556bc', '87e7fa70-ba74-4a2f-bc59-0bd2eaed2ce5'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:16 devstack sudo[109822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:10:16 devstack sudo[109822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:16 devstack sudo[109822]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.289s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:16 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Deleted volume successfully. Jul 31 11:10:16 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-f3cc2310-fb15-438c-ae9e-bdeba1be1d16 tempest-ProjectMemberTests-160500168 None] Lock "cinder-3e502519-351f-4990-9a2d-0d2fa738078c-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (62361c32-91f8-4f5d-bd08-747299adb6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03230385-c8b8-43fc-b604-64491099be5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03230385-c8b8-43fc-b604-64491099be5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-171497238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88342b89-599f-4b96-ba90-4250e3f44407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:17Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f7c9db-9fdd-4f06-81b9-81eb08146f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f7c9db-9fdd-4f06-81b9-81eb08146f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3ab528-4aee-4fdb-8b83-6e27790aca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3ab528-4aee-4fdb-8b83-6e27790aca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88342b89-599f-4b96-ba90-4250e3f44407', 'volume_name': 'volume-88342b89-599f-4b96-ba90-4250e3f44407', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a914664a-fa1b-4f8a-ba19-21670f2d2072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a914664a-fa1b-4f8a-ba19-21670f2d2072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e823df4-7eae-4921-8a50-ba9082f085a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:17 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Volume 88342b89-599f-4b96-ba90-4250e3f44407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88342b89-599f-4b96-ba90-4250e3f44407', 'volume_size': 1} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-171497238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88342b89-599f-4b96-ba90-4250e3f44407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:17Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Creating volume 88342b89-599f-4b96-ba90-4250e3f44407 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:17 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:17 devstack sudo[109826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 1073741824 Jul 31 11:10:17 devstack sudo[109826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:17 devstack sudo[109826]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 1073741824" returned: 0 in 0.456s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:17 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 Jul 31 11:10:17 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:18 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407" returned: 0 in 0.273s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:18 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e823df4-7eae-4921-8a50-ba9082f085a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88342b89-599f-4b96-ba90-4250e3f44407', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055117fa-57e1-48c1-b531-09b3acd574b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:18 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Volume volume-88342b89-599f-4b96-ba90-4250e3f44407 (88342b89-599f-4b96-ba90-4250e3f44407): created successfully Jul 31 11:10:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055117fa-57e1-48c1-b531-09b3acd574b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:18 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (62361c32-91f8-4f5d-bd08-747299adb6cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:18 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-53e42845-f1c9-4357-adc0-525719f428bd tempest-ProjectMemberTests-160500168 None] Created volume successfully. Jul 31 11:10:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] Creating offline snapshot 84cf2798-2e52-4736-8494-24084b00d9f2 of volume 88342b89-599f-4b96-ba90-4250e3f44407 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:10:19 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[363d6ab1-d150-46f2-a5f7-2650bc939389]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:19 devstack sudo[109838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 Jul 31 11:10:19 devstack sudo[109838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:20 devstack sudo[109838]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407" returned: 0 in 0.403s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:20 devstack sudo[109843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 1G Jul 31 11:10:20 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:20 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 1G" returned: 0 in 0.447s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88342b89-599f-4b96-ba90-4250e3f44407 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:20 devstack sudo[109849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88342b89-599f-4b96-ba90-4250e3f44407 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 Jul 31 11:10:20 devstack sudo[109849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:20 devstack sudo[109849]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88342b89-599f-4b96-ba90-4250e3f44407 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2" returned: 0 in 0.320s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:20 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 is being set with open permissions: ugo+rw Jul 31 11:10:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:20 devstack sudo[109855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 Jul 31 11:10:20 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:21 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2" returned: 0 in 0.262s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:21 devstack sudo[109859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.info Jul 31 11:10:21 devstack sudo[109859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:21 devstack sudo[109859]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.info" returned: 0 in 0.256s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:21 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.info is being set with open permissions: ugo+rw Jul 31 11:10:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:21 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.info Jul 31 11:10:21 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:21 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.info" returned: 0 in 0.267s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.046s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:21 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-dfcbac53-db7a-4dba-9e1a-ee779ca6739d tempest-ProjectMemberTests-160500168 None] Create snapshot completed successfully Jul 31 11:10:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-84cf2798-2e52-4736-8494-24084b00d9f2-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Lock "cinder-84cf2798-2e52-4736-8494-24084b00d9f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-88342b89-599f-4b96-ba90-4250e3f44407" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-88342b89-599f-4b96-ba90-4250e3f44407" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-84cf2798-2e52-4736-8494-24084b00d9f2" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-84cf2798-2e52-4736-8494-24084b00d9f2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Deleting offline snapshot 84cf2798-2e52-4736-8494-24084b00d9f2 of volume 88342b89-599f-4b96-ba90-4250e3f44407 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:10:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] snapshot_file for this snap is: volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:10:22 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[104279d7-58f7-4182-a4ae-d4ea733f4324]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:22 devstack sudo[109866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 Jul 31 11:10:22 devstack sudo[109866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:23 devstack sudo[109866]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2" returned: 0 in 0.365s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88342b89-599f-4b96-ba90-4250e3f44407(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:10:23 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[596161b6-9ecb-41b1-b347-a675dbc3010b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:23 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 Jul 31 11:10:23 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:23 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407" returned: 0 in 0.381s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:23 devstack sudo[109876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 Jul 31 11:10:23 devstack sudo[109876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:24 devstack sudo[109876]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2" returned: 0 in 0.355s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:24 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2 Jul 31 11:10:24 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:24 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407.84cf2798-2e52-4736-8494-24084b00d9f2" returned: 0 in 0.252s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-84cf2798-2e52-4736-8494-24084b00d9f2" released by "_delete_snapshot" :: held 1.494s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-88342b89-599f-4b96-ba90-4250e3f44407" released by "delete_snapshot" :: held 1.520s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:24 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Created reservations ['c1d6664c-b6fc-49d4-ab84-30ad0cad383c', '8b548851-21f2-4ab6-a94e-2bb85ae2e0d7', '4e73b088-3f67-4098-b38d-c27f93275c5a', '0b879343-9c6c-4db9-bd76-5369ccd01c83'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:24 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Delete snapshot completed successfully. Jul 31 11:10:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-17607a1b-48ce-4502-8eac-e24b65d60768 tempest-ProjectMemberTests-160500168 None] Lock "cinder-84cf2798-2e52-4736-8494-24084b00d9f2-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-88342b89-599f-4b96-ba90-4250e3f44407-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Lock "cinder-88342b89-599f-4b96-ba90-4250e3f44407-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-88342b89-599f-4b96-ba90-4250e3f44407" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-88342b89-599f-4b96-ba90-4250e3f44407" acquired by "delete_volume" :: waited 0.013s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fc518d-c37e-4090-a2dd-2f86d16697f4]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:25 devstack sudo[109886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 Jul 31 11:10:25 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:25 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407" returned: 0 in 0.357s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:25 devstack sudo[109891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407 Jul 31 11:10:25 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:25 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-88342b89-599f-4b96-ba90-4250e3f44407" returned: 0 in 0.238s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-88342b89-599f-4b96-ba90-4250e3f44407" released by "delete_volume" :: held 0.650s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Created reservations ['7b1e27b4-9f0c-4897-8199-375fd93ec621', '69ef1bde-63b8-4124-909f-da6e1e06c04b', '69bd1b09-939c-4597-ae70-03b50cf259f9', '00a2f7ea-a5d0-4aed-82f5-8cdd5745f76a'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:25 devstack sudo[109894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:10:25 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:25 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.241s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:26 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Deleted volume successfully. Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-5d23cf83-aa5c-4b8e-9b80-64a16e0649bc tempest-ProjectMemberTests-160500168 None] Lock "cinder-88342b89-599f-4b96-ba90-4250e3f44407-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (d2d90299-6946-444d-8d8a-1db522da77f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa02d675-e1b4-4146-afe3-76cbd6bc0541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa02d675-e1b4-4146-afe3-76cbd6bc0541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781529278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd99a39d-79de-4912-aa2b-66a0331112da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:26Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0068f348-1f1e-45fc-b29f-c282e46aece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0068f348-1f1e-45fc-b29f-c282e46aece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec73611e-4d5d-42a4-a6fa-bf292d4fe5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec73611e-4d5d-42a4-a6fa-bf292d4fe5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd99a39d-79de-4912-aa2b-66a0331112da', 'volume_name': 'volume-fd99a39d-79de-4912-aa2b-66a0331112da', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b759899-7183-4779-8de5-eab03128d00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b759899-7183-4779-8de5-eab03128d00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dd521d-65b5-4b40-8c04-75ba655ff3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Volume fd99a39d-79de-4912-aa2b-66a0331112da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd99a39d-79de-4912-aa2b-66a0331112da', 'volume_size': 1} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781529278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd99a39d-79de-4912-aa2b-66a0331112da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:26Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Creating volume fd99a39d-79de-4912-aa2b-66a0331112da {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:26 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:26 devstack sudo[109897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da 1073741824 Jul 31 11:10:26 devstack sudo[109897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:26 devstack sudo[109897]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da 1073741824" returned: 0 in 0.400s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:26 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=148,cinder:SELECT=114,cinder:DELETE=11,cinder:INSERT=39 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:27 devstack sudo[109903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da Jul 31 11:10:27 devstack sudo[109903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:27 devstack sudo[109903]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da" returned: 0 in 0.247s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dd521d-65b5-4b40-8c04-75ba655ff3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd99a39d-79de-4912-aa2b-66a0331112da', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e7e20b-474f-4810-a42d-91a17c286653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:27 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Volume volume-fd99a39d-79de-4912-aa2b-66a0331112da (fd99a39d-79de-4912-aa2b-66a0331112da): created successfully Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e7e20b-474f-4810-a42d-91a17c286653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (d2d90299-6946-444d-8d8a-1db522da77f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:27 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-339f30cd-31b2-47fd-81ac-4f21b1402d7b tempest-ProjectMemberTests-160500168 None] Created volume successfully. Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=102,cinder:INSERT=34,cinder:UPDATE=127,cinder:DELETE=13 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] Creating offline snapshot 5e81520a-03bb-4afa-8089-736a15b8460b of volume fd99a39d-79de-4912-aa2b-66a0331112da {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a6b445-3e91-4802-b4b4-ad68f9cedff2]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:27 devstack sudo[109906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da Jul 31 11:10:27 devstack sudo[109906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:28 devstack sudo[109906]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da" returned: 0 in 0.353s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:28 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b 1G Jul 31 11:10:28 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:28 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b 1G" returned: 0 in 0.390s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd99a39d-79de-4912-aa2b-66a0331112da -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:28 devstack sudo[109916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd99a39d-79de-4912-aa2b-66a0331112da -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b Jul 31 11:10:28 devstack sudo[109916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:28 devstack sudo[109916]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd99a39d-79de-4912-aa2b-66a0331112da -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b" returned: 0 in 0.296s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:28 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b is being set with open permissions: ugo+rw Jul 31 11:10:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:28 devstack sudo[109921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b Jul 31 11:10:28 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:28 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b" returned: 0 in 0.249s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:29 devstack sudo[109924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.info Jul 31 11:10:29 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:29 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.info" returned: 0 in 0.254s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:29 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.info is being set with open permissions: ugo+rw Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:29 devstack sudo[109927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.info Jul 31 11:10:29 devstack sudo[109927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:29 devstack sudo[109927]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.info" returned: 0 in 0.241s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-5c78d1ab-0f15-4dfc-a155-5335b8fb84a5 tempest-ProjectMemberTests-160500168 None] Create snapshot completed successfully Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-5e81520a-03bb-4afa-8089-736a15b8460b-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Lock "cinder-5e81520a-03bb-4afa-8089-736a15b8460b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-fd99a39d-79de-4912-aa2b-66a0331112da" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-fd99a39d-79de-4912-aa2b-66a0331112da" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-5e81520a-03bb-4afa-8089-736a15b8460b" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-5e81520a-03bb-4afa-8089-736a15b8460b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Deleting offline snapshot 5e81520a-03bb-4afa-8089-736a15b8460b of volume fd99a39d-79de-4912-aa2b-66a0331112da {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] snapshot_file for this snap is: volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55d8605-6310-4528-b06f-057a0e972dec]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:30 devstack sudo[109930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b Jul 31 11:10:30 devstack sudo[109930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:30 devstack sudo[109930]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b" returned: 0 in 0.341s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd99a39d-79de-4912-aa2b-66a0331112da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:10:30 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cd0528-a4a5-4028-8bc3-2c31ce10c554]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:30 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da Jul 31 11:10:30 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:30 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da" returned: 0 in 0.349s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:30 devstack sudo[109940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b Jul 31 11:10:30 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:30 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b" returned: 0 in 0.317s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:30 devstack sudo[109946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b Jul 31 11:10:30 devstack sudo[109946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:31 devstack sudo[109946]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da.5e81520a-03bb-4afa-8089-736a15b8460b" returned: 0 in 0.228s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-5e81520a-03bb-4afa-8089-736a15b8460b" released by "_delete_snapshot" :: held 1.323s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-fd99a39d-79de-4912-aa2b-66a0331112da" released by "delete_snapshot" :: held 1.344s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:31 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Created reservations ['995be8c8-fe44-4a60-8ad6-e03cec671ab9', '19027267-aed4-44f8-838d-c5f444e46e05', 'd61c91d4-b534-4fe0-8486-92b94579683e', '2b975e00-5fba-491c-a32e-c51e6bc0a1d5'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:31 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Delete snapshot completed successfully. Jul 31 11:10:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-30bd779b-6d07-4551-a4db-4c28361428e5 tempest-ProjectMemberTests-160500168 None] Lock "cinder-5e81520a-03bb-4afa-8089-736a15b8460b-delete_snapshot" released by "delete_snapshot" :: held 1.474s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-fd99a39d-79de-4912-aa2b-66a0331112da-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Lock "cinder-fd99a39d-79de-4912-aa2b-66a0331112da-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-fd99a39d-79de-4912-aa2b-66a0331112da" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-fd99a39d-79de-4912-aa2b-66a0331112da" acquired by "delete_volume" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8f4ad5-04f9-4f30-a8a0-9a0c156fe97d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:32 devstack sudo[109949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da Jul 31 11:10:32 devstack sudo[109949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:32 devstack sudo[109949]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da" returned: 0 in 0.361s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:32 devstack sudo[109954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da Jul 31 11:10:32 devstack sudo[109954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:32 devstack sudo[109954]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-fd99a39d-79de-4912-aa2b-66a0331112da" returned: 0 in 0.256s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-fd99a39d-79de-4912-aa2b-66a0331112da" released by "delete_volume" :: held 0.671s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Created reservations ['5777b4b3-c681-4dc9-8df2-f0d4b778fd9d', 'd7f1c436-06c5-4540-9883-70076f0df91e', '8c934ca2-74f6-42ff-95f2-c0b00c8366f6', 'e63e6b51-8b71-4f43-b718-5e58717403f3'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:32 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:10:32 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:33 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.238s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:33 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Deleted volume successfully. Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-4ff3b8d2-6af4-47a6-bb23-a2a3e399edc3 tempest-ProjectMemberTests-160500168 None] Lock "cinder-fd99a39d-79de-4912-aa2b-66a0331112da-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (8b370018-5d41-4a66-bcff-b6cc1996f564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215698e8-48e4-402e-82af-8848741a1397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215698e8-48e4-402e-82af-8848741a1397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150517137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e02745-0a2d-494d-aa74-94281139183e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:33Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e540bb4a-70f8-4f8d-a44a-74522b44bf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e540bb4a-70f8-4f8d-a44a-74522b44bf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82d4b71-c195-4f31-98d3-484a8f8632fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82d4b71-c195-4f31-98d3-484a8f8632fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e02745-0a2d-494d-aa74-94281139183e', 'volume_name': 'volume-97e02745-0a2d-494d-aa74-94281139183e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138ee144-40df-465a-926f-2a1c56891402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138ee144-40df-465a-926f-2a1c56891402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8906a23e-5615-417c-90f4-bcd402206ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:33 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Volume 97e02745-0a2d-494d-aa74-94281139183e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e02745-0a2d-494d-aa74-94281139183e', 'volume_size': 1} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150517137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e02745-0a2d-494d-aa74-94281139183e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:33Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Creating volume 97e02745-0a2d-494d-aa74-94281139183e {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:33 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:10:33 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:33 devstack sudo[109960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e 1073741824 Jul 31 11:10:33 devstack sudo[109960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:34 devstack sudo[109960]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e 1073741824" returned: 0 in 0.395s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:34 devstack sudo[109966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e Jul 31 11:10:34 devstack sudo[109966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:34 devstack sudo[109966]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e" returned: 0 in 0.230s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8906a23e-5615-417c-90f4-bcd402206ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e02745-0a2d-494d-aa74-94281139183e', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b3d952-6f9f-420c-b5b9-4c9ee5fae570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:34 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Volume volume-97e02745-0a2d-494d-aa74-94281139183e (97e02745-0a2d-494d-aa74-94281139183e): created successfully Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b3d952-6f9f-420c-b5b9-4c9ee5fae570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (8b370018-5d41-4a66-bcff-b6cc1996f564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:34 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-46b17c74-38db-4e40-8175-674d137fcfa2 tempest-ProjectMemberTests-160500168 None] Created volume successfully. Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] Creating offline snapshot 13ef3e87-2228-487d-95d7-26f228b26f17 of volume 97e02745-0a2d-494d-aa74-94281139183e {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd5a1a9-e4eb-455a-9423-85ae6e010d80]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:34 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:34 devstack sudo[109969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e Jul 31 11:10:34 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:35 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e" returned: 0 in 0.338s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:35 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 1G Jul 31 11:10:35 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:35 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 1G" returned: 0 in 0.396s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e02745-0a2d-494d-aa74-94281139183e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:35 devstack sudo[109979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e02745-0a2d-494d-aa74-94281139183e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 Jul 31 11:10:35 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:35 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e02745-0a2d-494d-aa74-94281139183e -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17" returned: 0 in 0.274s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:35 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 is being set with open permissions: ugo+rw Jul 31 11:10:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:35 devstack sudo[109985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 Jul 31 11:10:35 devstack sudo[109985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:35 devstack sudo[109985]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17" returned: 0 in 0.240s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:35 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:35 devstack sudo[109988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.info Jul 31 11:10:35 devstack sudo[109988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:36 devstack sudo[109988]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.info" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:36 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.info is being set with open permissions: ugo+rw Jul 31 11:10:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:36 devstack sudo[109991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.info Jul 31 11:10:36 devstack sudo[109991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:36 devstack sudo[109991]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.info" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.792s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:36 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f8d8d262-caed-47ee-9053-7f56440c1ab8 tempest-ProjectMemberTests-160500168 None] Create snapshot completed successfully Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-13ef3e87-2228-487d-95d7-26f228b26f17-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Lock "cinder-13ef3e87-2228-487d-95d7-26f228b26f17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-97e02745-0a2d-494d-aa74-94281139183e" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-97e02745-0a2d-494d-aa74-94281139183e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-13ef3e87-2228-487d-95d7-26f228b26f17" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-13ef3e87-2228-487d-95d7-26f228b26f17" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Deleting offline snapshot 13ef3e87-2228-487d-95d7-26f228b26f17 of volume 97e02745-0a2d-494d-aa74-94281139183e {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] snapshot_file for this snap is: volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90a3b90-97b5-4b51-831b-0d6de2c64d01]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:37 devstack sudo[110030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 Jul 31 11:10:37 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:37 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17" returned: 0 in 0.342s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e02745-0a2d-494d-aa74-94281139183e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d296d91-f54f-4517-a106-6939442938e6]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:37 devstack sudo[110035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e Jul 31 11:10:37 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:37 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e" returned: 0 in 0.341s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:37 devstack sudo[110040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 Jul 31 11:10:37 devstack sudo[110040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:38 devstack sudo[110040]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17" returned: 0 in 0.318s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:38 devstack sudo[110045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17 Jul 31 11:10:38 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:38 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e.13ef3e87-2228-487d-95d7-26f228b26f17" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-13ef3e87-2228-487d-95d7-26f228b26f17" released by "_delete_snapshot" :: held 1.330s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-97e02745-0a2d-494d-aa74-94281139183e" released by "delete_snapshot" :: held 1.352s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:38 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Created reservations ['836abd78-934e-402c-90db-7dd853869e4c', '658610be-676e-4458-b1bb-512abae5d1fe', '6e259ac1-0116-4695-9d37-8c40887fbe4c', '4905d836-313f-4dc5-9246-892139b75454'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Delete snapshot completed successfully. Jul 31 11:10:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-665e1187-faef-45cf-8f37-64109b88f163 tempest-ProjectMemberTests-160500168 None] Lock "cinder-13ef3e87-2228-487d-95d7-26f228b26f17-delete_snapshot" released by "delete_snapshot" :: held 1.482s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-97e02745-0a2d-494d-aa74-94281139183e-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Lock "cinder-97e02745-0a2d-494d-aa74-94281139183e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-97e02745-0a2d-494d-aa74-94281139183e" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-97e02745-0a2d-494d-aa74-94281139183e" acquired by "delete_volume" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5b2110-4d63-49a2-bdf0-61813f092de5]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:39 devstack sudo[110048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e Jul 31 11:10:39 devstack sudo[110048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:39 devstack sudo[110048]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e" returned: 0 in 0.348s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:39 devstack sudo[110053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e Jul 31 11:10:39 devstack sudo[110053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:39 devstack sudo[110053]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-97e02745-0a2d-494d-aa74-94281139183e" returned: 0 in 0.245s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-97e02745-0a2d-494d-aa74-94281139183e" released by "delete_volume" :: held 0.648s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Created reservations ['e091f5a3-b4fa-4bce-bb14-e2481bb5b472', '4ae12023-1f81-45b2-ba14-41e17e6b2f2c', '848043d7-93f1-494a-ba69-e56b74fa8ae0', 'e9e39809-6ac5-416d-9ea6-7eb8a65d0c47'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:40 devstack sudo[110056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:10:40 devstack sudo[110056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:40 devstack sudo[110056]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.241s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:40 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Deleted volume successfully. Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-9b5d24ad-2bce-441c-b987-6d1669f41695 tempest-ProjectMemberTests-160500168 None] Lock "cinder-97e02745-0a2d-494d-aa74-94281139183e-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (4cf23e74-0703-47f1-9232-693b463be53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78cf1c6e-4226-409f-b346-2355206364e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78cf1c6e-4226-409f-b346-2355206364e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1350633774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:41Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d461807-b2b9-42f9-9e87-da28ef80a507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d461807-b2b9-42f9-9e87-da28ef80a507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb590c86-64df-436b-bdf3-b6b196aef336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb590c86-64df-436b-bdf3-b6b196aef336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c', 'volume_name': 'volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90892d69-f00e-4f78-aaaf-85f7c5a3c02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90892d69-f00e-4f78-aaaf-85f7c5a3c02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73121912-a1dd-4072-bfcb-e44380b89348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:40 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Volume b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c', 'volume_size': 1} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1350633774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:41Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Creating volume b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:40 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:10:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:40 devstack sudo[110059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c 1073741824 Jul 31 11:10:40 devstack sudo[110059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:41 devstack sudo[110059]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c 1073741824" returned: 0 in 0.413s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:41 devstack sudo[110064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c Jul 31 11:10:41 devstack sudo[110064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:41 devstack sudo[110064]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c" returned: 0 in 0.229s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73121912-a1dd-4072-bfcb-e44380b89348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01362b06-ac88-4138-9a94-8f4eb66bf4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:41 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Volume volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c (b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c): created successfully Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01362b06-ac88-4138-9a94-8f4eb66bf4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (4cf23e74-0703-47f1-9232-693b463be53a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:41 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f255ab77-e743-4074-a413-3f932a865b51 tempest-ProjectMemberTests-160500168 None] Created volume successfully. Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] Creating offline snapshot 83130f18-9198-4b2c-a66f-da8f79fe9106 of volume b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a42b5-a271-41e5-9449-e6c0fd4e8d00]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:42 devstack sudo[110067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c Jul 31 11:10:42 devstack sudo[110067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:42 devstack sudo[110067]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c" returned: 0 in 0.347s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:42 devstack sudo[110072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 1G Jul 31 11:10:42 devstack sudo[110072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:42 devstack sudo[110072]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 1G" returned: 0 in 0.370s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:42 devstack sudo[110077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 Jul 31 11:10:42 devstack sudo[110077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:42 devstack sudo[110077]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106" returned: 0 in 0.288s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:42 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 is being set with open permissions: ugo+rw Jul 31 11:10:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:42 devstack sudo[110082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 Jul 31 11:10:42 devstack sudo[110082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:43 devstack sudo[110082]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106" returned: 0 in 0.246s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:43 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.info Jul 31 11:10:43 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:43 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.info" returned: 0 in 0.244s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:43 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.info is being set with open permissions: ugo+rw Jul 31 11:10:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:43 devstack sudo[110088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.info Jul 31 11:10:43 devstack sudo[110088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:43 devstack sudo[110088]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.info" returned: 0 in 0.245s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.815s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:43 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-31eff0b9-062f-4aae-a038-79585df2e67f tempest-ProjectMemberTests-160500168 None] Create snapshot completed successfully Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-83130f18-9198-4b2c-a66f-da8f79fe9106-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Lock "cinder-83130f18-9198-4b2c-a66f-da8f79fe9106-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-83130f18-9198-4b2c-a66f-da8f79fe9106" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-83130f18-9198-4b2c-a66f-da8f79fe9106" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Deleting offline snapshot 83130f18-9198-4b2c-a66f-da8f79fe9106 of volume b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] snapshot_file for this snap is: volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfa40df-48ec-41a9-a1de-9e2a11ea4834]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:44 devstack sudo[110092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 Jul 31 11:10:44 devstack sudo[110092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:44 devstack sudo[110092]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106" returned: 0 in 0.364s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d1261a-1439-43f5-827c-60bab89ed8f4]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:44 devstack sudo[110097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c Jul 31 11:10:44 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:44 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c" returned: 0 in 0.364s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:44 devstack sudo[110102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 Jul 31 11:10:44 devstack sudo[110102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:45 devstack sudo[110102]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106" returned: 0 in 0.325s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:45 devstack sudo[110108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106 Jul 31 11:10:45 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:45 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c.83130f18-9198-4b2c-a66f-da8f79fe9106" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-83130f18-9198-4b2c-a66f-da8f79fe9106" released by "_delete_snapshot" :: held 1.375s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c" released by "delete_snapshot" :: held 1.397s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:45 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Created reservations ['0f537d50-68d2-4244-a778-0444924a9c5a', 'fe9653f0-932c-4846-a7ab-c216755f6e40', '58f728d5-b4fc-48a4-8268-72936db5f5ac', 'e720e7c7-4085-46f0-81e9-b477a6185d9b'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Delete snapshot completed successfully. Jul 31 11:10:45 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-87ab1cfa-9354-4317-ae7f-366a55d91861 tempest-ProjectMemberTests-160500168 None] Lock "cinder-83130f18-9198-4b2c-a66f-da8f79fe9106-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Lock "cinder-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9c64cf-4580-4f1a-a979-abbc67409836]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:46 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c Jul 31 11:10:46 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:46 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c" returned: 0 in 0.351s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:46 devstack sudo[110116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c Jul 31 11:10:46 devstack sudo[110116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:46 devstack sudo[110116]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c" returned: 0 in 0.236s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c" released by "delete_volume" :: held 0.646s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:46 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Created reservations ['0b6db830-3f6b-4509-9918-9ca15f6525a1', '1a34a3ae-5e5f-4549-9d0d-9d1cd90cea42', 'dbfccafe-32de-41c0-b42a-25ad180345b0', '58f63d97-f943-4a9f-9c49-0c8f0968db6e'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:47 devstack sudo[110125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:10:47 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:47 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.240s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:47 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Deleted volume successfully. Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-759a0ca6-48a2-40fb-a306-15871055f51a tempest-ProjectMemberTests-160500168 None] Lock "cinder-b09bdb7e-e95a-4cf2-a1cf-ebbc39ab779c-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (ef7cd1e9-ae96-4d60-a871-719ab73e7aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a560356-a349-4062-b462-82f2afe7cc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a560356-a349-4062-b462-82f2afe7cc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1841964717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ede489-4017-4372-9f54-1b7c63ced6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:48Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b2007a-1a7f-45cd-9a2e-a6fdb071d220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b2007a-1a7f-45cd-9a2e-a6fdb071d220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36dc8c78-df75-420f-bf3f-3e53db6f5a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36dc8c78-df75-420f-bf3f-3e53db6f5a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ede489-4017-4372-9f54-1b7c63ced6ad', 'volume_name': 'volume-18ede489-4017-4372-9f54-1b7c63ced6ad', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe44be4-42bb-4ea6-8225-67b151e0f5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe44be4-42bb-4ea6-8225-67b151e0f5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63946500-f8e1-4f2b-974c-fc3da0a218aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:47 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Volume 18ede489-4017-4372-9f54-1b7c63ced6ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ede489-4017-4372-9f54-1b7c63ced6ad', 'volume_size': 1} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1841964717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ede489-4017-4372-9f54-1b7c63ced6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb80420fd07f4d7ca37b536d04d86d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:48Z,use_quota=True,user_id='dda1f0dda6c94bbb87fedc097549c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Creating volume 18ede489-4017-4372-9f54-1b7c63ced6ad {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:47 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:10:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:47 devstack sudo[110128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad 1073741824 Jul 31 11:10:47 devstack sudo[110128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:48 devstack sudo[110128]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad 1073741824" returned: 0 in 0.387s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:48 devstack sudo[110133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad Jul 31 11:10:48 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:48 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63946500-f8e1-4f2b-974c-fc3da0a218aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ede489-4017-4372-9f54-1b7c63ced6ad', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2b431c-3908-4543-ae2a-b996a79701c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:48 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Volume volume-18ede489-4017-4372-9f54-1b7c63ced6ad (18ede489-4017-4372-9f54-1b7c63ced6ad): created successfully Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2b431c-3908-4543-ae2a-b996a79701c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Flow 'volume_create_manager' (ef7cd1e9-ae96-4d60-a871-719ab73e7aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:48 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-48dcb04c-b19a-4daf-867f-3088fb7c5c4e tempest-ProjectMemberTests-160500168 None] Created volume successfully. Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] Creating offline snapshot baf947c0-5cba-44c7-9923-97bf8cc420f0 of volume 18ede489-4017-4372-9f54-1b7c63ced6ad {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a440fc-7b03-4bff-afa4-99a650664c3e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:49 devstack sudo[110138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad Jul 31 11:10:49 devstack sudo[110138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:49 devstack sudo[110138]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad" returned: 0 in 0.340s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:49 devstack sudo[110143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 1G Jul 31 11:10:49 devstack sudo[110143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:49 devstack sudo[110143]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 1G" returned: 0 in 0.370s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ede489-4017-4372-9f54-1b7c63ced6ad -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:49 devstack sudo[110149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ede489-4017-4372-9f54-1b7c63ced6ad -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 Jul 31 11:10:49 devstack sudo[110149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:49 devstack sudo[110149]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ede489-4017-4372-9f54-1b7c63ced6ad -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0" returned: 0 in 0.287s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:49 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 is being set with open permissions: ugo+rw Jul 31 11:10:49 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:49 devstack sudo[110155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 Jul 31 11:10:49 devstack sudo[110155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:50 devstack sudo[110155]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0" returned: 0 in 0.236s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:50 devstack sudo[110158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.info Jul 31 11:10:50 devstack sudo[110158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:50 devstack sudo[110158]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.info" returned: 0 in 0.241s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:50 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.info is being set with open permissions: ugo+rw Jul 31 11:10:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:50 devstack sudo[110161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.info Jul 31 11:10:50 devstack sudo[110161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:50 devstack sudo[110161]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.info" returned: 0 in 0.248s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:50 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:50 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-90fdf49b-05a9-470e-aabd-6149fd8ca569 tempest-ProjectMemberTests-160500168 None] Create snapshot completed successfully Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-baf947c0-5cba-44c7-9923-97bf8cc420f0-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Lock "cinder-baf947c0-5cba-44c7-9923-97bf8cc420f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-18ede489-4017-4372-9f54-1b7c63ced6ad" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-18ede489-4017-4372-9f54-1b7c63ced6ad" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-baf947c0-5cba-44c7-9923-97bf8cc420f0" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-baf947c0-5cba-44c7-9923-97bf8cc420f0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Deleting offline snapshot baf947c0-5cba-44c7-9923-97bf8cc420f0 of volume 18ede489-4017-4372-9f54-1b7c63ced6ad {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] snapshot_file for this snap is: volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b4a704-e4e1-4317-9ca4-c86c8a1204df]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:51 devstack sudo[110164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 Jul 31 11:10:51 devstack sudo[110164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:51 devstack sudo[110164]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0" returned: 0 in 0.339s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18ede489-4017-4372-9f54-1b7c63ced6ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dfe06d-2258-4862-a84c-4a02194a65d3]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:51 devstack sudo[110171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad Jul 31 11:10:51 devstack sudo[110171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:51 devstack sudo[110171]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad" returned: 0 in 0.343s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:51 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:51 devstack sudo[110176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 Jul 31 11:10:51 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:52 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0" returned: 0 in 0.318s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:52 devstack sudo[110181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0 Jul 31 11:10:52 devstack sudo[110181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:52 devstack sudo[110181]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:52 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad.baf947c0-5cba-44c7-9923-97bf8cc420f0" returned: 0 in 0.234s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-baf947c0-5cba-44c7-9923-97bf8cc420f0" released by "_delete_snapshot" :: held 1.322s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-18ede489-4017-4372-9f54-1b7c63ced6ad" released by "delete_snapshot" :: held 1.341s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:52 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Created reservations ['d14d5f75-cf4f-49d7-a4f4-9c5c5af2106a', 'cd044100-3d55-4672-a2f2-15f825c9f8fa', '554c25f8-c6ba-40d7-81af-bf46fa2ada6a', 'cc6f268e-65d2-49bc-b5a7-426553f28228'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:52 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Delete snapshot completed successfully. Jul 31 11:10:52 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e7414656-ce04-4a40-a7c5-4dd5c072a8ab tempest-ProjectMemberTests-160500168 None] Lock "cinder-baf947c0-5cba-44c7-9923-97bf8cc420f0-delete_snapshot" released by "delete_snapshot" :: held 1.469s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-18ede489-4017-4372-9f54-1b7c63ced6ad-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Lock "cinder-18ede489-4017-4372-9f54-1b7c63ced6ad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Acquiring lock "cinder-quobyte-18ede489-4017-4372-9f54-1b7c63ced6ad" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:53 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-18ede489-4017-4372-9f54-1b7c63ced6ad" acquired by "delete_volume" :: waited 0.023s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:53 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[6633ed70-af5a-4026-93d9-bff57a7785e0]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:53 devstack sudo[110184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad Jul 31 11:10:53 devstack sudo[110184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:53 devstack sudo[110184]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad" returned: 0 in 0.349s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:53 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:53 devstack sudo[110189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad Jul 31 11:10:53 devstack sudo[110189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:53 devstack sudo[110189]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-18ede489-4017-4372-9f54-1b7c63ced6ad" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Lock "cinder-quobyte-18ede489-4017-4372-9f54-1b7c63ced6ad" released by "delete_volume" :: held 0.638s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:54 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Created reservations ['d5a47787-e732-4339-aab2-69b2a2fcd19e', '0ba0a504-f74d-48af-a19d-d31480339a4d', '86b7aa02-5a08-4cc7-becf-c8c6abb3fe3a', 'dca30000-3b54-4e60-8867-11b9901d09a3'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:54 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:54 devstack sudo[110193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:10:54 devstack sudo[110193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:54 devstack sudo[110193]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:54 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.244s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:54 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:54 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Deleted volume successfully. Jul 31 11:10:54 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-2f2f3d0e-818f-4d6b-9551-784d0239532b tempest-ProjectMemberTests-160500168 None] Lock "cinder-18ede489-4017-4372-9f54-1b7c63ced6ad-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:57 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Flow 'volume_create_manager' (cc02bf26-c1c7-45d4-b6ff-405049d281bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:57 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016fd6d5-858a-4470-b0c4-8a2fe126640e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016fd6d5-858a-4470-b0c4-8a2fe126640e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842341793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53f837c-da03-4983-9284-3095b592a079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da077987e4624114998204996a75bb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:58Z,use_quota=True,user_id='a97ffcc687e64bcb8e1d756ba8a5dde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506ef705-f725-4cd5-a543-0b2018b3fa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506ef705-f725-4cd5-a543-0b2018b3fa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ed44e4-f289-4431-b7a4-c3e99091e9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ed44e4-f289-4431-b7a4-c3e99091e9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd53f837c-da03-4983-9284-3095b592a079', 'volume_name': 'volume-d53f837c-da03-4983-9284-3095b592a079', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d5d74f-ce62-4dd5-8ee1-75210c61605c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d5d74f-ce62-4dd5-8ee1-75210c61605c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa338371-76de-49f7-8a1c-2be6a306de7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:58 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Volume d53f837c-da03-4983-9284-3095b592a079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d53f837c-da03-4983-9284-3095b592a079', 'volume_size': 1} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842341793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53f837c-da03-4983-9284-3095b592a079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da077987e4624114998204996a75bb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:58Z,use_quota=True,user_id='a97ffcc687e64bcb8e1d756ba8a5dde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Creating volume d53f837c-da03-4983-9284-3095b592a079 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:58 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:58 devstack sudo[110196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 1073741824 Jul 31 11:10:58 devstack sudo[110196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:58 devstack sudo[110196]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 1073741824" returned: 0 in 0.446s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:58 devstack sudo[110202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 Jul 31 11:10:58 devstack sudo[110202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:58 devstack sudo[110202]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079" returned: 0 in 0.262s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa338371-76de-49f7-8a1c-2be6a306de7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d53f837c-da03-4983-9284-3095b592a079', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6745e67b-c583-4355-91ee-020e038acaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:58 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Volume volume-d53f837c-da03-4983-9284-3095b592a079 (d53f837c-da03-4983-9284-3095b592a079): created successfully Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6745e67b-c583-4355-91ee-020e038acaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:58 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Flow 'volume_create_manager' (cc02bf26-c1c7-45d4-b6ff-405049d281bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:58 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f2c7f749-81a5-4759-8884-d59bb2143da7 tempest-ProjectReaderTests-830247734 None] Created volume successfully. Jul 31 11:10:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:59 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] Creating offline snapshot dfe1934a-221c-402f-91b0-21323b571807 of volume d53f837c-da03-4983-9284-3095b592a079 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:10:59 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[989e37c8-965f-49e6-bb4a-5bfb52ced35e]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:59 devstack sudo[110205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 Jul 31 11:10:59 devstack sudo[110205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:59 devstack sudo[110205]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079" returned: 0 in 0.350s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:59 devstack sudo[110210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 1G Jul 31 11:10:59 devstack sudo[110210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:59 devstack sudo[110210]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 1G" returned: 0 in 0.413s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:59 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d53f837c-da03-4983-9284-3095b592a079 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:59 devstack sudo[110215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d53f837c-da03-4983-9284-3095b592a079 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 Jul 31 11:10:59 devstack sudo[110215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:00 devstack sudo[110215]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d53f837c-da03-4983-9284-3095b592a079 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807" returned: 0 in 0.277s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:00 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 is being set with open permissions: ugo+rw Jul 31 11:11:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:00 devstack sudo[110220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 Jul 31 11:11:00 devstack sudo[110220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:00 devstack sudo[110220]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:00 devstack sudo[110223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.info Jul 31 11:11:00 devstack sudo[110223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:00 devstack sudo[110223]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.info" returned: 0 in 0.251s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:00 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.info is being set with open permissions: ugo+rw Jul 31 11:11:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:00 devstack sudo[110226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.info Jul 31 11:11:00 devstack sudo[110226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:00 devstack sudo[110226]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.info" returned: 0 in 0.230s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:00 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:01 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-9c903508-43f4-4e57-9d45-97fa695bbc75 tempest-ProjectReaderTests-830247734 None] Create snapshot completed successfully Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-dfe1934a-221c-402f-91b0-21323b571807-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Lock "cinder-dfe1934a-221c-402f-91b0-21323b571807-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-d53f837c-da03-4983-9284-3095b592a079" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-d53f837c-da03-4983-9284-3095b592a079" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-dfe1934a-221c-402f-91b0-21323b571807" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-dfe1934a-221c-402f-91b0-21323b571807" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Deleting offline snapshot dfe1934a-221c-402f-91b0-21323b571807 of volume d53f837c-da03-4983-9284-3095b592a079 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] snapshot_file for this snap is: volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c12e7c4-8448-4b7e-8088-3363e21a3957]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:01 devstack sudo[110229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 Jul 31 11:11:01 devstack sudo[110229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:01 devstack sudo[110229]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807" returned: 0 in 0.345s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d53f837c-da03-4983-9284-3095b592a079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3a28b5-735a-41b6-871a-790e7218e058]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:01 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:01 devstack sudo[110234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 Jul 31 11:11:01 devstack sudo[110234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:02 devstack sudo[110234]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079" returned: 0 in 0.345s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:02 devstack sudo[110239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 Jul 31 11:11:02 devstack sudo[110239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:02 devstack sudo[110239]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807" returned: 0 in 0.341s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:02 devstack sudo[110244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807 Jul 31 11:11:02 devstack sudo[110244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:02 devstack sudo[110244]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:02 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079.dfe1934a-221c-402f-91b0-21323b571807" returned: 0 in 0.238s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-dfe1934a-221c-402f-91b0-21323b571807" released by "_delete_snapshot" :: held 1.362s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-d53f837c-da03-4983-9284-3095b592a079" released by "delete_snapshot" :: held 1.384s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:02 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Created reservations ['81a5256e-40b0-45dc-80b0-d75ba800b16f', 'c9794f23-3d45-476f-b7cb-7ca84cb8189e', 'fa0609ba-3faf-4d6e-9dcb-7d87ddf59957', '614bfca4-b981-423a-8a74-62e192d6c4e3'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:02 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Delete snapshot completed successfully. Jul 31 11:11:02 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-7d43d4d1-15be-4ca4-a89e-9835c439b055 tempest-ProjectReaderTests-830247734 None] Lock "cinder-dfe1934a-221c-402f-91b0-21323b571807-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-d53f837c-da03-4983-9284-3095b592a079-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Lock "cinder-d53f837c-da03-4983-9284-3095b592a079-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-d53f837c-da03-4983-9284-3095b592a079" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:03 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-d53f837c-da03-4983-9284-3095b592a079" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:03 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa329a4-4801-421d-9099-85e2f613b5cb]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:03 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:03 devstack sudo[110247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 Jul 31 11:11:03 devstack sudo[110247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:04 devstack sudo[110247]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079" returned: 0 in 0.353s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:04 devstack sudo[110253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079 Jul 31 11:11:04 devstack sudo[110253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:04 devstack sudo[110253]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-d53f837c-da03-4983-9284-3095b592a079" returned: 0 in 0.246s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-d53f837c-da03-4983-9284-3095b592a079" released by "delete_volume" :: held 0.656s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Created reservations ['b0b1fabe-58e3-49d2-95c5-384915007250', 'bf081410-e117-4e83-9143-d9a8b921435d', '02b009d4-69d6-44e0-b9db-a45c81cb9643', 'edbb2611-88a0-482f-9f32-158b10764408'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:04 devstack sudo[110256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:11:04 devstack sudo[110256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:04 devstack sudo[110256]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.240s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:04 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Deleted volume successfully. Jul 31 11:11:04 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-91c2a12a-c667-4974-a48f-72765119c9d5 tempest-ProjectReaderTests-830247734 None] Lock "cinder-d53f837c-da03-4983-9284-3095b592a079-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Flow 'volume_create_manager' (446204e5-762e-48f0-b488-2eb8cef4d966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e1c05f-45d5-4f9f-bd85-78a071ef43de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e1c05f-45d5-4f9f-bd85-78a071ef43de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-511058523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f4a3f7-b402-42bb-8118-e3fe70d3234a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da077987e4624114998204996a75bb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:05Z,use_quota=True,user_id='a97ffcc687e64bcb8e1d756ba8a5dde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c2e5e7-57d5-4d74-baf0-c6aa762ff29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c2e5e7-57d5-4d74-baf0-c6aa762ff29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400936c1-a716-4ba8-8def-6bee04dd84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400936c1-a716-4ba8-8def-6bee04dd84cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f4a3f7-b402-42bb-8118-e3fe70d3234a', 'volume_name': 'volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416c0f28-d598-4258-aa94-cdcf2681bd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416c0f28-d598-4258-aa94-cdcf2681bd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653315e8-fc81-4738-96a3-df597b17b364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Volume 08f4a3f7-b402-42bb-8118-e3fe70d3234a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a', 'volume_size': 1} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-511058523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f4a3f7-b402-42bb-8118-e3fe70d3234a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da077987e4624114998204996a75bb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:05Z,use_quota=True,user_id='a97ffcc687e64bcb8e1d756ba8a5dde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Creating volume 08f4a3f7-b402-42bb-8118-e3fe70d3234a {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:05 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:05 devstack sudo[110259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a 1073741824 Jul 31 11:11:05 devstack sudo[110259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:05 devstack sudo[110259]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a 1073741824" returned: 0 in 0.399s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:05 devstack sudo[110264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a Jul 31 11:11:05 devstack sudo[110264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:05 devstack sudo[110264]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653315e8-fc81-4738-96a3-df597b17b364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8615f89e-e00d-445b-b22e-42a99b6ca67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:05 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Volume volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a (08f4a3f7-b402-42bb-8118-e3fe70d3234a): created successfully Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8615f89e-e00d-445b-b22e-42a99b6ca67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:05 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Flow 'volume_create_manager' (446204e5-762e-48f0-b488-2eb8cef4d966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:05 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-f5a3a5c6-2a36-449f-a332-bce3eb5e3148 tempest-ProjectReaderTests-830247734 None] Created volume successfully. Jul 31 11:11:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:06 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] Creating offline snapshot 084a6ee1-e185-47c4-9b3b-a01d74ba8b07 of volume 08f4a3f7-b402-42bb-8118-e3fe70d3234a {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:11:06 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb58063-2fe9-427d-acc9-d6a6c35099cb]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:06 devstack sudo[110267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a Jul 31 11:11:06 devstack sudo[110267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:06 devstack sudo[110267]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a" returned: 0 in 0.356s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:06 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:06 devstack sudo[110272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 1G Jul 31 11:11:06 devstack sudo[110272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:07 devstack sudo[110272]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 1G" returned: 0 in 0.378s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:07 devstack sudo[110277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 Jul 31 11:11:07 devstack sudo[110277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:07 devstack sudo[110277]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07" returned: 0 in 0.281s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:07 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 is being set with open permissions: ugo+rw Jul 31 11:11:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:07 devstack sudo[110282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 Jul 31 11:11:07 devstack sudo[110282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:07 devstack sudo[110282]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07" returned: 0 in 0.241s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:07 devstack sudo[110285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.info Jul 31 11:11:07 devstack sudo[110285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:07 devstack sudo[110285]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.info" returned: 0 in 0.243s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:07 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.info is being set with open permissions: ugo+rw Jul 31 11:11:07 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:07 devstack sudo[110288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.info Jul 31 11:11:07 devstack sudo[110288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:08 devstack sudo[110288]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.info" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:08 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-c5048b27-d99e-4e89-a899-2f96f49720db tempest-ProjectReaderTests-830247734 None] Create snapshot completed successfully Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:08 devstack sudo[110291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:11:08 devstack sudo[110291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-084a6ee1-e185-47c4-9b3b-a01d74ba8b07-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Lock "cinder-084a6ee1-e185-47c4-9b3b-a01d74ba8b07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-08f4a3f7-b402-42bb-8118-e3fe70d3234a" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-08f4a3f7-b402-42bb-8118-e3fe70d3234a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-084a6ee1-e185-47c4-9b3b-a01d74ba8b07" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-084a6ee1-e185-47c4-9b3b-a01d74ba8b07" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Deleting offline snapshot 084a6ee1-e185-47c4-9b3b-a01d74ba8b07 of volume 08f4a3f7-b402-42bb-8118-e3fe70d3234a {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] snapshot_file for this snap is: volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b258be6-a93e-465e-9f8f-32324efb62c6]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:08 devstack sudo[110291]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.288s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo_service.periodic_task [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] Running periodic task VolumeManager._thread_info {{(pid=89145) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread count: 28 {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-c03e30b9-9b7e-425d-86c0-1d0a35cd0b36 None None] thread info: [<_MainThread(MainThread, started 139916169314432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89145) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:11:08 devstack sudo[110294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 Jul 31 11:11:08 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:08 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07" returned: 0 in 0.352s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3f45dd-5c7d-4b7f-9055-21813d4f27b5]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:08 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:09 devstack sudo[110299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a Jul 31 11:11:09 devstack sudo[110299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:09 devstack sudo[110299]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a" returned: 0 in 0.358s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:09 devstack sudo[110304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 Jul 31 11:11:09 devstack sudo[110304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:09 devstack sudo[110304]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07" returned: 0 in 0.344s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:09 devstack sudo[110309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07 Jul 31 11:11:09 devstack sudo[110309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:09 devstack sudo[110309]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:09 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a.084a6ee1-e185-47c4-9b3b-a01d74ba8b07" returned: 0 in 0.246s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-084a6ee1-e185-47c4-9b3b-a01d74ba8b07" released by "_delete_snapshot" :: held 1.402s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:09 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-08f4a3f7-b402-42bb-8118-e3fe70d3234a" released by "delete_snapshot" :: held 1.426s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:09 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Created reservations ['e09b159a-f1fc-426c-bc13-a7cbc554ea35', '0e4c00f7-5a58-46c5-9638-1634a1868ecb', '9ca742ff-574d-444a-ac84-3a93ce2202e4', '2f9927cd-b967-4394-98ed-09d12b16ab0d'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:10 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Delete snapshot completed successfully. Jul 31 11:11:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-e385bcd5-66bf-4320-8997-d604492fa814 tempest-ProjectReaderTests-830247734 None] Lock "cinder-084a6ee1-e185-47c4-9b3b-a01d74ba8b07-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-08f4a3f7-b402-42bb-8118-e3fe70d3234a-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Lock "cinder-08f4a3f7-b402-42bb-8118-e3fe70d3234a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-08f4a3f7-b402-42bb-8118-e3fe70d3234a" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:10 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-08f4a3f7-b402-42bb-8118-e3fe70d3234a" acquired by "delete_volume" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:10 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[345f029f-06b8-4f5f-91b4-3782d021cc29]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:10 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:10 devstack sudo[110312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a Jul 31 11:11:10 devstack sudo[110312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:11 devstack sudo[110312]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a" returned: 0 in 0.348s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:11 devstack sudo[110317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a Jul 31 11:11:11 devstack sudo[110317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:11 devstack sudo[110317]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-08f4a3f7-b402-42bb-8118-e3fe70d3234a" returned: 0 in 0.256s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-08f4a3f7-b402-42bb-8118-e3fe70d3234a" released by "delete_volume" :: held 0.661s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Created reservations ['35b10c37-6c93-4d73-a536-9e599faf1618', 'cc548c50-5c6b-4bfe-af89-c0fbfd2885b8', 'cf2c32ed-1ae7-4ac1-9aba-ee58e3ab78c2', '66d3544b-e2db-4fd7-8922-34ea4b6dc106'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:11 devstack sudo[110320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:11:11 devstack sudo[110320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:11 devstack sudo[110320]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.248s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:11 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Deleted volume successfully. Jul 31 11:11:11 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3e543be8-8ee0-4f39-a4ba-1c422ec26feb tempest-ProjectReaderTests-830247734 None] Lock "cinder-08f4a3f7-b402-42bb-8118-e3fe70d3234a-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Flow 'volume_create_manager' (f776aec9-d98c-4113-ad0e-40aa5cd2e7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc16e79-3d8e-4ea2-8104-ba8836cc5b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc16e79-3d8e-4ea2-8104-ba8836cc5b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873907789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8d44da-2033-4714-8d1a-6cc29ed0e8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da077987e4624114998204996a75bb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:12Z,use_quota=True,user_id='a97ffcc687e64bcb8e1d756ba8a5dde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e94d4a1-5b43-4981-a48c-4f4a0d5df675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e94d4a1-5b43-4981-a48c-4f4a0d5df675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e657786f-82b6-467d-8099-2e9181c40844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e657786f-82b6-467d-8099-2e9181c40844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be8d44da-2033-4714-8d1a-6cc29ed0e8d7', 'volume_name': 'volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2efc90-dc45-44a5-9f8e-2ba0d084840e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2efc90-dc45-44a5-9f8e-2ba0d084840e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfe70a6-0f05-43aa-b395-8a1bcb9cf5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:12 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Volume be8d44da-2033-4714-8d1a-6cc29ed0e8d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7', 'volume_size': 1} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873907789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8d44da-2033-4714-8d1a-6cc29ed0e8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da077987e4624114998204996a75bb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:12Z,use_quota=True,user_id='a97ffcc687e64bcb8e1d756ba8a5dde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Creating volume be8d44da-2033-4714-8d1a-6cc29ed0e8d7 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:12 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:12 devstack sudo[110323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 1073741824 Jul 31 11:11:12 devstack sudo[110323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:12 devstack sudo[110323]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 1073741824" returned: 0 in 0.430s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:12 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:12 devstack sudo[110328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 Jul 31 11:11:12 devstack sudo[110328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:13 devstack sudo[110328]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7" returned: 0 in 0.247s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfe70a6-0f05-43aa-b395-8a1bcb9cf5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f0a6e2-b52e-4b38-b3e7-f52174c5dbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:13 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Volume volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 (be8d44da-2033-4714-8d1a-6cc29ed0e8d7): created successfully Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f0a6e2-b52e-4b38-b3e7-f52174c5dbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Flow 'volume_create_manager' (f776aec9-d98c-4113-ad0e-40aa5cd2e7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:13 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d1151f04-23ff-4e84-972a-017a41f4c828 tempest-ProjectReaderTests-830247734 None] Created volume successfully. Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] Creating offline snapshot 25a258b1-69d8-4b4c-8364-2fbae137e45f of volume be8d44da-2033-4714-8d1a-6cc29ed0e8d7 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6de2e52-1784-4d2e-bb0e-b9fc55cf5e62]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:13 devstack sudo[110331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 Jul 31 11:11:13 devstack sudo[110331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:13 devstack sudo[110331]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7" returned: 0 in 0.359s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:13 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:13 devstack sudo[110336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f 1G Jul 31 11:11:13 devstack sudo[110336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:14 devstack sudo[110336]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f 1G" returned: 0 in 0.382s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:14 devstack sudo[110342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f Jul 31 11:11:14 devstack sudo[110342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:14 devstack sudo[110342]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f" returned: 0 in 0.306s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:14 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f is being set with open permissions: ugo+rw Jul 31 11:11:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:14 devstack sudo[110347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f Jul 31 11:11:14 devstack sudo[110347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:14 devstack sudo[110347]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f" returned: 0 in 0.258s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:14 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:14 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.info Jul 31 11:11:14 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:15 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.info" returned: 0 in 0.281s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:15 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.info is being set with open permissions: ugo+rw Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:15 devstack sudo[110353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.info Jul 31 11:11:15 devstack sudo[110353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:15 devstack sudo[110353]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.info" returned: 0 in 0.240s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:15 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-138b3f3c-5613-40ee-9b46-8f8d788237c1 tempest-ProjectReaderTests-830247734 None] Create snapshot completed successfully Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-25a258b1-69d8-4b4c-8364-2fbae137e45f-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Lock "cinder-25a258b1-69d8-4b4c-8364-2fbae137e45f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-be8d44da-2033-4714-8d1a-6cc29ed0e8d7" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-be8d44da-2033-4714-8d1a-6cc29ed0e8d7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-25a258b1-69d8-4b4c-8364-2fbae137e45f" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-25a258b1-69d8-4b4c-8364-2fbae137e45f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Deleting offline snapshot 25a258b1-69d8-4b4c-8364-2fbae137e45f of volume be8d44da-2033-4714-8d1a-6cc29ed0e8d7 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] snapshot_file for this snap is: volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc776926-86f3-4dcf-9a02-adc1e37a7acc]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:15 devstack sudo[110356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f Jul 31 11:11:15 devstack sudo[110356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:15 devstack sudo[110356]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f" returned: 0 in 0.363s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:15 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:11:16 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[534b9a52-15c9-4b5a-b6a6-63bb16859017]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:16 devstack sudo[110361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 Jul 31 11:11:16 devstack sudo[110361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:16 devstack sudo[110361]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7" returned: 0 in 0.363s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:16 devstack sudo[110366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f Jul 31 11:11:16 devstack sudo[110366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:16 devstack sudo[110366]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f" returned: 0 in 0.353s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:16 devstack sudo[110371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f Jul 31 11:11:16 devstack sudo[110371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:16 devstack sudo[110371]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:16 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7.25a258b1-69d8-4b4c-8364-2fbae137e45f" returned: 0 in 0.261s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-25a258b1-69d8-4b4c-8364-2fbae137e45f" released by "_delete_snapshot" :: held 1.440s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-be8d44da-2033-4714-8d1a-6cc29ed0e8d7" released by "delete_snapshot" :: held 1.464s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:17 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Created reservations ['9e9be0a9-3560-4532-89d2-560477cd8982', '4282a4e6-50a2-4443-ab25-bb6bd5df3452', '0fba76da-291c-4537-89e0-9dcd80d01887', '036793d9-95ae-495e-9df2-e875b7cd7988'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:17 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Delete snapshot completed successfully. Jul 31 11:11:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-39eee477-a79b-4543-a8a1-7987fce6b2e4 tempest-ProjectReaderTests-830247734 None] Lock "cinder-25a258b1-69d8-4b4c-8364-2fbae137e45f-delete_snapshot" released by "delete_snapshot" :: held 1.605s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-be8d44da-2033-4714-8d1a-6cc29ed0e8d7-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Lock "cinder-be8d44da-2033-4714-8d1a-6cc29ed0e8d7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-be8d44da-2033-4714-8d1a-6cc29ed0e8d7" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:17 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-be8d44da-2033-4714-8d1a-6cc29ed0e8d7" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:17 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[09102c6b-68e9-49c5-bdd4-fdd9b16146da]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:17 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:17 devstack sudo[110374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 Jul 31 11:11:17 devstack sudo[110374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:18 devstack sudo[110374]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7" returned: 0 in 0.370s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:18 devstack sudo[110379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7 Jul 31 11:11:18 devstack sudo[110379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:18 devstack sudo[110379]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-be8d44da-2033-4714-8d1a-6cc29ed0e8d7" returned: 0 in 0.255s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-be8d44da-2033-4714-8d1a-6cc29ed0e8d7" released by "delete_volume" :: held 0.688s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Created reservations ['f515c128-b0a9-40e2-9696-70eb936d036f', '79d0dc77-246e-4e98-91ec-7c076e0c271f', 'e1ce6aa8-59ca-4d3a-889e-05fb9a321969', 'e77a1321-cf65-4a0a-abea-2001675276cf'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:18 devstack sudo[110382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:11:18 devstack sudo[110382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:18 devstack sudo[110382]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.259s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:18 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Deleted volume successfully. Jul 31 11:11:18 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-3ae46e35-58b2-4c56-8ffe-04d3d841e78b tempest-ProjectReaderTests-830247734 None] Lock "cinder-be8d44da-2033-4714-8d1a-6cc29ed0e8d7-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Flow 'volume_create_manager' (44f01596-138e-46e7-9b06-dd893cd22f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeddee18-63f5-443b-952b-b3b50ed4172d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeddee18-63f5-443b-952b-b3b50ed4172d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-921446871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c73ece-6a66-4cf0-977e-2ce3517b4938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da077987e4624114998204996a75bb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:19Z,use_quota=True,user_id='a97ffcc687e64bcb8e1d756ba8a5dde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3324c14-c694-471d-99db-a5ca376f01ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3324c14-c694-471d-99db-a5ca376f01ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad476ded-5621-4181-b541-8c6aee5c7e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad476ded-5621-4181-b541-8c6aee5c7e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9c73ece-6a66-4cf0-977e-2ce3517b4938', 'volume_name': 'volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a0552a-02f5-4a2e-b846-e0fec5f4ac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a0552a-02f5-4a2e-b846-e0fec5f4ac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421b93f4-063b-4b5e-8350-4b03b2d9d237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:19 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Volume e9c73ece-6a66-4cf0-977e-2ce3517b4938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938', 'volume_size': 1} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-921446871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c73ece-6a66-4cf0-977e-2ce3517b4938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da077987e4624114998204996a75bb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:19Z,use_quota=True,user_id='a97ffcc687e64bcb8e1d756ba8a5dde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Creating volume e9c73ece-6a66-4cf0-977e-2ce3517b4938 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:19 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:19 devstack sudo[110385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 1073741824 Jul 31 11:11:19 devstack sudo[110385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:19 devstack sudo[110385]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 1073741824" returned: 0 in 0.418s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:19 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:19 devstack sudo[110391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 Jul 31 11:11:19 devstack sudo[110391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:20 devstack sudo[110391]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938" returned: 0 in 0.237s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421b93f4-063b-4b5e-8350-4b03b2d9d237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3cff1f1-3870-4914-a776-fb8059ebbd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:20 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Volume volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 (e9c73ece-6a66-4cf0-977e-2ce3517b4938): created successfully Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3cff1f1-3870-4914-a776-fb8059ebbd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Flow 'volume_create_manager' (44f01596-138e-46e7-9b06-dd893cd22f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:20 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-01b1a0b4-df3b-4409-b69f-4901f8b0fe34 tempest-ProjectReaderTests-830247734 None] Created volume successfully. Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] Creating offline snapshot dd28dada-d133-43ed-a84d-fda7e59a5b51 of volume e9c73ece-6a66-4cf0-977e-2ce3517b4938 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e5c973-fe10-414f-9153-502509f1e078]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:20 devstack sudo[110395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 Jul 31 11:11:20 devstack sudo[110395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:20 devstack sudo[110395]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938" returned: 0 in 0.381s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:20 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:20 devstack sudo[110400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 1G Jul 31 11:11:20 devstack sudo[110400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:21 devstack sudo[110400]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 1G" returned: 0 in 0.381s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:21 devstack sudo[110405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 Jul 31 11:11:21 devstack sudo[110405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:21 devstack sudo[110405]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51" returned: 0 in 0.312s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:21 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 is being set with open permissions: ugo+rw Jul 31 11:11:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:21 devstack sudo[110410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 Jul 31 11:11:21 devstack sudo[110410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:21 devstack sudo[110410]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51" returned: 0 in 0.244s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:21 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:21 devstack sudo[110413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.info Jul 31 11:11:21 devstack sudo[110413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:22 devstack sudo[110413]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.info" returned: 0 in 0.236s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:22 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.info is being set with open permissions: ugo+rw Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:22 devstack sudo[110416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.info Jul 31 11:11:22 devstack sudo[110416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:22 devstack sudo[110416]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.info" returned: 0 in 0.227s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:22 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-3904bdd6-b3d2-43a8-b906-59b1f6246cfe tempest-ProjectReaderTests-830247734 None] Create snapshot completed successfully Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-dd28dada-d133-43ed-a84d-fda7e59a5b51-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Lock "cinder-dd28dada-d133-43ed-a84d-fda7e59a5b51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-e9c73ece-6a66-4cf0-977e-2ce3517b4938" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-e9c73ece-6a66-4cf0-977e-2ce3517b4938" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-dd28dada-d133-43ed-a84d-fda7e59a5b51" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-dd28dada-d133-43ed-a84d-fda7e59a5b51" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Deleting offline snapshot dd28dada-d133-43ed-a84d-fda7e59a5b51 of volume e9c73ece-6a66-4cf0-977e-2ce3517b4938 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] snapshot_file for this snap is: volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5dafb3-1f71-434f-ab3f-2245831902d3]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:22 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:22 devstack sudo[110419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 Jul 31 11:11:22 devstack sudo[110419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:23 devstack sudo[110419]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51" returned: 0 in 0.334s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:23 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:11:23 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c81d1e5-31ee-449a-b2bc-e6a7e9bfb3c7]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:23 devstack sudo[110424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 Jul 31 11:11:23 devstack sudo[110424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:23 devstack sudo[110424]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938" returned: 0 in 0.343s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:23 devstack sudo[110429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 Jul 31 11:11:23 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:23 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51" returned: 0 in 0.348s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:23 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:23 devstack sudo[110435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51 Jul 31 11:11:23 devstack sudo[110435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:24 devstack sudo[110435]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938.dd28dada-d133-43ed-a84d-fda7e59a5b51" returned: 0 in 0.251s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-dd28dada-d133-43ed-a84d-fda7e59a5b51" released by "_delete_snapshot" :: held 1.358s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-e9c73ece-6a66-4cf0-977e-2ce3517b4938" released by "delete_snapshot" :: held 1.380s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:24 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Created reservations ['5d2cb9a7-ff92-4856-ab9a-88827d1ab768', '0480bd39-66d4-4db3-82d8-1328e1782201', '61ecb237-42c1-4d0b-b29c-45dfa0adde05', 'acc949e1-4dad-48b9-8548-86b4b5d15180'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:24 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Delete snapshot completed successfully. Jul 31 11:11:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-d40658ae-f114-4802-adec-bec149714476 tempest-ProjectReaderTests-830247734 None] Lock "cinder-dd28dada-d133-43ed-a84d-fda7e59a5b51-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-e9c73ece-6a66-4cf0-977e-2ce3517b4938-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Lock "cinder-e9c73ece-6a66-4cf0-977e-2ce3517b4938-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-e9c73ece-6a66-4cf0-977e-2ce3517b4938" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:24 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-e9c73ece-6a66-4cf0-977e-2ce3517b4938" acquired by "delete_volume" :: waited 0.014s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:24 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5260ab0-d407-4294-a46a-669767d7938d]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:24 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:25 devstack sudo[110439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 Jul 31 11:11:25 devstack sudo[110439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:25 devstack sudo[110439]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938" returned: 0 in 0.362s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:25 devstack sudo[110444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938 Jul 31 11:11:25 devstack sudo[110444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:25 devstack sudo[110444]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-e9c73ece-6a66-4cf0-977e-2ce3517b4938" returned: 0 in 0.232s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-e9c73ece-6a66-4cf0-977e-2ce3517b4938" released by "delete_volume" :: held 0.651s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Created reservations ['d2ce1732-148a-47c7-b8a9-21289c4939a6', '8272c24b-5e90-4488-a579-207c4db59ab0', '44cb7c7a-a970-425e-a87b-1d8c3e34ce4f', 'b5320f6c-1028-4d90-8eb2-a4497f519406'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:25 devstack sudo[110447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:11:25 devstack sudo[110447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:25 devstack sudo[110447]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.242s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:25 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Deleted volume successfully. Jul 31 11:11:25 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-772631f6-f968-4ca3-9c26-13c8c7e92f46 tempest-ProjectReaderTests-830247734 None] Lock "cinder-e9c73ece-6a66-4cf0-977e-2ce3517b4938-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Flow 'volume_create_manager' (8f73cbd1-c65c-4572-bd7c-8776c8f9573c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b812e05-d489-42f2-a290-260d6c367423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b812e05-d489-42f2-a290-260d6c367423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2043498562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fdffe8-f054-472b-8fba-de8602757db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da077987e4624114998204996a75bb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:26Z,use_quota=True,user_id='a97ffcc687e64bcb8e1d756ba8a5dde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73957bc0-5467-4deb-a56e-7e528f72da7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73957bc0-5467-4deb-a56e-7e528f72da7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44c64d6-e0d5-4420-927d-62ac03cef5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44c64d6-e0d5-4420-927d-62ac03cef5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26fdffe8-f054-472b-8fba-de8602757db8', 'volume_name': 'volume-26fdffe8-f054-472b-8fba-de8602757db8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0cb369-592e-4795-bd56-2a9680f6e8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0cb369-592e-4795-bd56-2a9680f6e8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044b7ff1-3eef-4101-8621-f82495a4640f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:26 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Volume 26fdffe8-f054-472b-8fba-de8602757db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26fdffe8-f054-472b-8fba-de8602757db8', 'volume_size': 1} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2043498562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fdffe8-f054-472b-8fba-de8602757db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da077987e4624114998204996a75bb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:26Z,use_quota=True,user_id='a97ffcc687e64bcb8e1d756ba8a5dde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Creating volume 26fdffe8-f054-472b-8fba-de8602757db8 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:26 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:26 devstack sudo[110450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 1073741824 Jul 31 11:11:26 devstack sudo[110450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:26 devstack sudo[110450]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 1073741824" returned: 0 in 0.402s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:26 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:26 devstack sudo[110456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 Jul 31 11:11:26 devstack sudo[110456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:27 devstack sudo[110456]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8" returned: 0 in 0.237s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044b7ff1-3eef-4101-8621-f82495a4640f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fdffe8-f054-472b-8fba-de8602757db8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764488e0-7306-484b-9b11-fec268c33a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:27 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Volume volume-26fdffe8-f054-472b-8fba-de8602757db8 (26fdffe8-f054-472b-8fba-de8602757db8): created successfully Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764488e0-7306-484b-9b11-fec268c33a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Flow 'volume_create_manager' (8f73cbd1-c65c-4572-bd7c-8776c8f9573c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=153,cinder:SELECT=106,cinder:DELETE=13,cinder:INSERT=41 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:11:27 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-e98ee94c-036e-4da8-aeb2-5f43f8de8cbd tempest-ProjectReaderTests-830247734 None] Created volume successfully. Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:SELECT=120,cinder:UPDATE=138,cinder:INSERT=39,cinder:DELETE=11 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] Creating offline snapshot 6324f99a-2768-4d38-95c2-0e93cb0df8a2 of volume 26fdffe8-f054-472b-8fba-de8602757db8 {{(pid=89145) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a11c83-fc55-498e-aa7d-dc3a89bce486]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:27 devstack sudo[110459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 Jul 31 11:11:27 devstack sudo[110459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:27 devstack sudo[110459]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8" returned: 0 in 0.355s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:27 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 1G {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:27 devstack sudo[110464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 1G Jul 31 11:11:27 devstack sudo[110464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:28 devstack sudo[110464]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 1G" returned: 0 in 0.418s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fdffe8-f054-472b-8fba-de8602757db8 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:28 devstack sudo[110469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fdffe8-f054-472b-8fba-de8602757db8 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 Jul 31 11:11:28 devstack sudo[110469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:28 devstack sudo[110469]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fdffe8-f054-472b-8fba-de8602757db8 -F qcow2 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2" returned: 0 in 0.296s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:28 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 is being set with open permissions: ugo+rw Jul 31 11:11:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:28 devstack sudo[110474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 Jul 31 11:11:28 devstack sudo[110474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:28 devstack sudo[110474]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2" returned: 0 in 0.255s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:28 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:28 devstack sudo[110477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.info Jul 31 11:11:28 devstack sudo[110477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:29 devstack sudo[110477]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.info" returned: 0 in 0.261s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:29 devstack cinder-volume[89145]: WARNING cinder.volume.drivers.remotefs [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.info is being set with open permissions: ugo+rw Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.info {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:29 devstack sudo[110480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.info Jul 31 11:11:29 devstack sudo[110480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:29 devstack sudo[110480]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.info" returned: 0 in 0.263s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:29 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-023b9da2-da2c-42a9-8e8c-efa431c2f66d tempest-ProjectReaderTests-830247734 None] Create snapshot completed successfully Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-6324f99a-2768-4d38-95c2-0e93cb0df8a2-delete_snapshot" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Lock "cinder-6324f99a-2768-4d38-95c2-0e93cb0df8a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-26fdffe8-f054-472b-8fba-de8602757db8" by "delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-26fdffe8-f054-472b-8fba-de8602757db8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-6324f99a-2768-4d38-95c2-0e93cb0df8a2" by "_delete_snapshot" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-6324f99a-2768-4d38-95c2-0e93cb0df8a2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Deleting offline snapshot 6324f99a-2768-4d38-95c2-0e93cb0df8a2 of volume 26fdffe8-f054-472b-8fba-de8602757db8 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] snapshot_file for this snap is: volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 {{(pid=89145) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25700a5-e99b-437e-a4ab-44c4cdd5070a]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:29 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:29 devstack sudo[110483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 Jul 31 11:11:29 devstack sudo[110483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:30 devstack sudo[110483]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2" returned: 0 in 0.353s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:30 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26fdffe8-f054-472b-8fba-de8602757db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89145) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:11:30 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0581dfd-5a28-4eab-956c-4cff17abf419]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:30 devstack sudo[110488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 Jul 31 11:11:30 devstack sudo[110488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:30 devstack sudo[110488]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8" returned: 0 in 0.348s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:30 devstack sudo[110493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 Jul 31 11:11:30 devstack sudo[110493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:30 devstack sudo[110493]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2" returned: 0 in 0.372s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:30 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:30 devstack sudo[110499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2 Jul 31 11:11:30 devstack sudo[110499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:31 devstack sudo[110499]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8.6324f99a-2768-4d38-95c2-0e93cb0df8a2" returned: 0 in 0.235s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-6324f99a-2768-4d38-95c2-0e93cb0df8a2" released by "_delete_snapshot" :: held 1.401s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-26fdffe8-f054-472b-8fba-de8602757db8" released by "delete_snapshot" :: held 1.425s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:31 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Created reservations ['6edae11c-bfaa-44eb-93ee-618cc8dccdc6', '60d25b0f-8394-43cf-8e78-0b0f78b96781', '133e2526-7bf7-4e63-9ee7-1ae4f7e54b59', 'da63f636-5a02-4133-a717-d202404cf256'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:31 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Delete snapshot completed successfully. Jul 31 11:11:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6a5d3c1a-4adf-4ed2-8363-84c76d2c44b2 tempest-ProjectReaderTests-830247734 None] Lock "cinder-6324f99a-2768-4d38-95c2-0e93cb0df8a2-delete_snapshot" released by "delete_snapshot" :: held 1.563s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-26fdffe8-f054-472b-8fba-de8602757db8-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Lock "cinder-26fdffe8-f054-472b-8fba-de8602757db8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Acquiring lock "cinder-quobyte-26fdffe8-f054-472b-8fba-de8602757db8" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:31 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-26fdffe8-f054-472b-8fba-de8602757db8" acquired by "delete_volume" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:31 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[940c750a-c7e2-4945-a9d5-46080c1c9c08]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:31 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:32 devstack sudo[110502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 Jul 31 11:11:32 devstack sudo[110502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:32 devstack sudo[110502]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8" returned: 0 in 0.356s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:32 devstack sudo[110507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8 Jul 31 11:11:32 devstack sudo[110507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:32 devstack sudo[110507]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-26fdffe8-f054-472b-8fba-de8602757db8" returned: 0 in 0.252s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Lock "cinder-quobyte-26fdffe8-f054-472b-8fba-de8602757db8" released by "delete_volume" :: held 0.666s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Created reservations ['6b326b52-270f-4ca2-8706-0ac9078a0184', '2623dbcf-bdbe-4eab-9a3a-3e8a5daa6043', 'a7cf33bd-85c3-4005-a90d-5ff07bbdbafe', '39844b71-7878-49b9-a659-89d8611820bb'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:32 devstack sudo[110510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:11:32 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:32 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.251s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:32 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:32 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Deleted volume successfully. Jul 31 11:11:33 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6cf0e26d-56e9-4bf9-9c60-4c3d5e084b5c tempest-ProjectReaderTests-830247734 None] Lock "cinder-26fdffe8-f054-472b-8fba-de8602757db8-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Flow 'volume_create_manager' (3daee0b7-dc3a-40ba-91d3-9e5fe4bb8be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963e8b58-b6c2-4f3f-92d2-ac2cbe670893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963e8b58-b6c2-4f3f-92d2-ac2cbe670893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103451142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30de737-70b1-4fe3-9648-a17463b14cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0f69ee9b774a40beb7e43f16e7b56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:37Z,use_quota=True,user_id='558b916542604db6b6750f0b686e5da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6100df1-79ad-4c7c-8db4-913219eeab89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6100df1-79ad-4c7c-8db4-913219eeab89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ecc051-a8bf-4f8e-ba44-d5a4d08868b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ecc051-a8bf-4f8e-ba44-d5a4d08868b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30de737-70b1-4fe3-9648-a17463b14cb8', 'volume_name': 'volume-a30de737-70b1-4fe3-9648-a17463b14cb8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243d2a5a-9518-4504-a6b8-b394a920abc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243d2a5a-9518-4504-a6b8-b394a920abc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdfe7c2-68fb-40f1-a141-7a2145794ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:36 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Volume a30de737-70b1-4fe3-9648-a17463b14cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30de737-70b1-4fe3-9648-a17463b14cb8', 'volume_size': 1} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103451142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30de737-70b1-4fe3-9648-a17463b14cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0f69ee9b774a40beb7e43f16e7b56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:37Z,use_quota=True,user_id='558b916542604db6b6750f0b686e5da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Creating volume a30de737-70b1-4fe3-9648-a17463b14cb8 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:36 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:11:36 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a30de737-70b1-4fe3-9648-a17463b14cb8 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:36 devstack sudo[110515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a30de737-70b1-4fe3-9648-a17463b14cb8 1073741824 Jul 31 11:11:36 devstack sudo[110515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:37 devstack sudo[110515]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a30de737-70b1-4fe3-9648-a17463b14cb8 1073741824" returned: 0 in 0.429s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a30de737-70b1-4fe3-9648-a17463b14cb8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:37 devstack sudo[110557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a30de737-70b1-4fe3-9648-a17463b14cb8 Jul 31 11:11:37 devstack sudo[110557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:37 devstack sudo[110557]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a30de737-70b1-4fe3-9648-a17463b14cb8" returned: 0 in 0.255s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdfe7c2-68fb-40f1-a141-7a2145794ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30de737-70b1-4fe3-9648-a17463b14cb8', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad97691-f6d0-4f27-b643-2beb70f379a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:37 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Volume volume-a30de737-70b1-4fe3-9648-a17463b14cb8 (a30de737-70b1-4fe3-9648-a17463b14cb8): created successfully Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad97691-f6d0-4f27-b643-2beb70f379a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Flow 'volume_create_manager' (3daee0b7-dc3a-40ba-91d3-9e5fe4bb8be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:37 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-27db5fc7-c9aa-4a4d-804c-3a358a951fe5 tempest-ProjectReaderTests-239160976 None] Created volume successfully. Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Acquiring lock "cinder-a30de737-70b1-4fe3-9648-a17463b14cb8-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Lock "cinder-a30de737-70b1-4fe3-9648-a17463b14cb8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Acquiring lock "cinder-quobyte-a30de737-70b1-4fe3-9648-a17463b14cb8" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Lock "cinder-quobyte-a30de737-70b1-4fe3-9648-a17463b14cb8" acquired by "delete_volume" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad6f023-b1b4-4082-9a6a-b6359e6bd36b]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:37 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a30de737-70b1-4fe3-9648-a17463b14cb8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:38 devstack sudo[110560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a30de737-70b1-4fe3-9648-a17463b14cb8 Jul 31 11:11:38 devstack sudo[110560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:38 devstack sudo[110560]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a30de737-70b1-4fe3-9648-a17463b14cb8" returned: 0 in 0.359s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a30de737-70b1-4fe3-9648-a17463b14cb8 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:38 devstack sudo[110565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a30de737-70b1-4fe3-9648-a17463b14cb8 Jul 31 11:11:38 devstack sudo[110565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:38 devstack sudo[110565]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-a30de737-70b1-4fe3-9648-a17463b14cb8" returned: 0 in 0.260s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Lock "cinder-quobyte-a30de737-70b1-4fe3-9648-a17463b14cb8" released by "delete_volume" :: held 0.656s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Created reservations ['c1dd004a-c278-4217-bccf-7971a41499cb', '5f83d810-4afd-49dd-b46c-d729cd8ca07f', '20ce58db-cc38-4202-a405-5cbbceb10f82', '9fddc685-c651-4289-b317-1495105cb6f6'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:38 devstack sudo[110568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:11:38 devstack sudo[110568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:38 devstack sudo[110568]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.236s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:38 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Deleted volume successfully. Jul 31 11:11:38 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-0f9ec2c7-8098-447b-b7cb-347b03454c58 tempest-ProjectReaderTests-239160976 None] Lock "cinder-a30de737-70b1-4fe3-9648-a17463b14cb8-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Flow 'volume_create_manager' (c36d5200-878e-44c6-88ff-1e8f4a181ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199af456-10ca-423e-b5a9-52742c73afc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199af456-10ca-423e-b5a9-52742c73afc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2016850913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793c423f-7d93-4ecb-b4ef-3c916e140ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0f69ee9b774a40beb7e43f16e7b56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:39Z,use_quota=True,user_id='558b916542604db6b6750f0b686e5da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79fbab40-1f2d-4b53-8314-78dac7e5ab77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79fbab40-1f2d-4b53-8314-78dac7e5ab77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf1d079-afb1-483f-8ee5-0f450d07ba98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf1d079-afb1-483f-8ee5-0f450d07ba98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '793c423f-7d93-4ecb-b4ef-3c916e140ee0', 'volume_name': 'volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb5b35b-669d-4e07-9d4b-0986bd7e160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb5b35b-669d-4e07-9d4b-0986bd7e160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63a8855-ac4e-4903-aac5-0c5a51616903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Volume 793c423f-7d93-4ecb-b4ef-3c916e140ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0', 'volume_size': 1} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2016850913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793c423f-7d93-4ecb-b4ef-3c916e140ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0f69ee9b774a40beb7e43f16e7b56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:39Z,use_quota=True,user_id='558b916542604db6b6750f0b686e5da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Creating volume 793c423f-7d93-4ecb-b4ef-3c916e140ee0 {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:39 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:39 devstack sudo[110571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0 1073741824 Jul 31 11:11:39 devstack sudo[110571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:39 devstack sudo[110571]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0 1073741824" returned: 0 in 0.435s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:39 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:40 devstack sudo[110576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0 Jul 31 11:11:40 devstack sudo[110576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:40 devstack sudo[110576]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0" returned: 0 in 0.236s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63a8855-ac4e-4903-aac5-0c5a51616903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8c8285-31ae-46eb-a273-08478ab27598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:40 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Volume volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0 (793c423f-7d93-4ecb-b4ef-3c916e140ee0): created successfully Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8c8285-31ae-46eb-a273-08478ab27598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Flow 'volume_create_manager' (c36d5200-878e-44c6-88ff-1e8f4a181ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:40 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8fcdf7bd-d5f1-40e4-8311-01fff95ce966 tempest-ProjectReaderTests-239160976 None] Created volume successfully. Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Acquiring lock "cinder-793c423f-7d93-4ecb-b4ef-3c916e140ee0-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Lock "cinder-793c423f-7d93-4ecb-b4ef-3c916e140ee0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Acquiring lock "cinder-quobyte-793c423f-7d93-4ecb-b4ef-3c916e140ee0" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Lock "cinder-quobyte-793c423f-7d93-4ecb-b4ef-3c916e140ee0" acquired by "delete_volume" :: waited 0.015s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f76ee21-e3bc-4f56-b401-d8705f277a95]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:40 devstack sudo[110579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0 Jul 31 11:11:40 devstack sudo[110579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:40 devstack sudo[110579]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0" returned: 0 in 0.339s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:40 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:40 devstack sudo[110584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0 Jul 31 11:11:40 devstack sudo[110584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:41 devstack sudo[110584]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-793c423f-7d93-4ecb-b4ef-3c916e140ee0" returned: 0 in 0.230s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Lock "cinder-quobyte-793c423f-7d93-4ecb-b4ef-3c916e140ee0" released by "delete_volume" :: held 0.609s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:41 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Created reservations ['1cf05be1-015b-4e35-989f-94a852184d76', 'd4ab6fc5-f293-486e-8aad-770c6d31e720', 'e1debd93-d69a-415c-a7cf-09e5d241240c', '9e2a0791-0808-411e-8c89-83ccef80e374'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:41 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:41 devstack sudo[110587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:11:41 devstack sudo[110587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:41 devstack sudo[110587]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:41 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.262s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:41 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:41 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Deleted volume successfully. Jul 31 11:11:41 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-349c0173-755c-4850-a719-47947ab1a13b tempest-ProjectReaderTests-239160976 None] Lock "cinder-793c423f-7d93-4ecb-b4ef-3c916e140ee0-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Flow 'volume_create_manager' (0d93934f-220d-40bc-8bcd-33d148a4efe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddcccbf-13aa-46e4-8a45-bd5d406de15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddcccbf-13aa-46e4-8a45-bd5d406de15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57935924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8383c7f0-88a2-407e-8fb9-0e6f8ed7346c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0f69ee9b774a40beb7e43f16e7b56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:42Z,use_quota=True,user_id='558b916542604db6b6750f0b686e5da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023d4dc2-21c1-4ff2-92bd-3781593d14a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023d4dc2-21c1-4ff2-92bd-3781593d14a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9275ccaf-1bd7-4924-a69d-46e932c40679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9275ccaf-1bd7-4924-a69d-46e932c40679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8383c7f0-88a2-407e-8fb9-0e6f8ed7346c', 'volume_name': 'volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b85ef8a-b31f-422c-bb40-be16c2793158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b85ef8a-b31f-422c-bb40-be16c2793158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bbd6faa-b68f-48a5-97e8-d1539e5a1fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:42 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Volume 8383c7f0-88a2-407e-8fb9-0e6f8ed7346c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c', 'volume_size': 1} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57935924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8383c7f0-88a2-407e-8fb9-0e6f8ed7346c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0f69ee9b774a40beb7e43f16e7b56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:42Z,use_quota=True,user_id='558b916542604db6b6750f0b686e5da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Creating volume 8383c7f0-88a2-407e-8fb9-0e6f8ed7346c {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:42 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:42 devstack sudo[110590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c 1073741824 Jul 31 11:11:42 devstack sudo[110590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:42 devstack sudo[110590]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c 1073741824" returned: 0 in 0.406s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:42 devstack sudo[110596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c Jul 31 11:11:42 devstack sudo[110596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:42 devstack sudo[110596]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c" returned: 0 in 0.284s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bbd6faa-b68f-48a5-97e8-d1539e5a1fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3405a0-8706-4c51-82ed-5ad4ba9c49fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:42 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Volume volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c (8383c7f0-88a2-407e-8fb9-0e6f8ed7346c): created successfully Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3405a0-8706-4c51-82ed-5ad4ba9c49fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:42 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Flow 'volume_create_manager' (0d93934f-220d-40bc-8bcd-33d148a4efe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:42 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-ecfc725b-5448-402a-a85b-b3328e46c86f tempest-ProjectReaderTests-239160976 None] Created volume successfully. Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Acquiring lock "cinder-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Lock "cinder-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Acquiring lock "cinder-quobyte-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Lock "cinder-quobyte-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c" acquired by "delete_volume" :: waited 0.022s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[13351936-d6bd-45a6-bfbd-2c9bfd800b44]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:43 devstack sudo[110599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c Jul 31 11:11:43 devstack sudo[110599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:43 devstack sudo[110599]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c" returned: 0 in 0.355s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:43 devstack sudo[110604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c Jul 31 11:11:43 devstack sudo[110604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:43 devstack sudo[110604]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c" returned: 0 in 0.259s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Lock "cinder-quobyte-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c" released by "delete_volume" :: held 0.653s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Created reservations ['6f95bdc3-3157-4039-b12a-9397d667eab8', '685dc2f1-51d9-457b-9121-c93ddb1f7aea', '349c9c36-d632-4f9c-b49b-bca21f8c9120', 'db9e4391-3f20-4f5b-a768-dbcea60b8008'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:43 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:43 devstack sudo[110609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:11:43 devstack sudo[110609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:44 devstack sudo[110609]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.255s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:44 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Deleted volume successfully. Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-8b997f6d-35a4-41bb-93b4-418d9afd0697 tempest-ProjectReaderTests-239160976 None] Lock "cinder-8383c7f0-88a2-407e-8fb9-0e6f8ed7346c-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.flows.manager.create_volume [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89145) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Flow 'volume_create_manager' (c7fe9fd1-2e03-496d-ab0d-1b91f5f17cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526f9751-7651-46a5-a24b-902f7f616613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526f9751-7651-46a5-a24b-902f7f616613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-208828276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29feee8-8acb-4f73-93c2-149286b431ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0f69ee9b774a40beb7e43f16e7b56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:45Z,use_quota=True,user_id='558b916542604db6b6750f0b686e5da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad735847-47cc-4b68-828e-3ea9d09a8e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad735847-47cc-4b68-828e-3ea9d09a8e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0a07e2-505b-437b-84fa-215964f815a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0a07e2-505b-437b-84fa-215964f815a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f29feee8-8acb-4f73-93c2-149286b431ab', 'volume_name': 'volume-f29feee8-8acb-4f73-93c2-149286b431ab', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f66268-3942-4549-ab88-b6ff7178cc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f66268-3942-4549-ab88-b6ff7178cc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732280ef-1b65-483d-b4cc-8ef7899c1b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:44 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Volume f29feee8-8acb-4f73-93c2-149286b431ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f29feee8-8acb-4f73-93c2-149286b431ab', 'volume_size': 1} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-208828276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29feee8-8acb-4f73-93c2-149286b431ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0f69ee9b774a40beb7e43f16e7b56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:45Z,use_quota=True,user_id='558b916542604db6b6750f0b686e5da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1052317-eef8-4e2e-bede-651f47a7ba1e),volume_type_id=d1052317-eef8-4e2e-bede-651f47a7ba1e)}" {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.remotefs [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Creating volume f29feee8-8acb-4f73-93c2-149286b431ab {{(pid=89145) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Selected osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 as target Quobyte volume. {{(pid=89145) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:44 devstack cinder-volume[89145]: INFO cinder.volume.drivers.remotefs [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] casted to osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445 Jul 31 11:11:44 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f29feee8-8acb-4f73-93c2-149286b431ab 1073741824 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:44 devstack sudo[110612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f29feee8-8acb-4f73-93c2-149286b431ab 1073741824 Jul 31 11:11:44 devstack sudo[110612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:45 devstack sudo[110612]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f29feee8-8acb-4f73-93c2-149286b431ab 1073741824" returned: 0 in 0.465s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f29feee8-8acb-4f73-93c2-149286b431ab {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:45 devstack sudo[110617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f29feee8-8acb-4f73-93c2-149286b431ab Jul 31 11:11:45 devstack sudo[110617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:45 devstack sudo[110617]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f29feee8-8acb-4f73-93c2-149286b431ab" returned: 0 in 0.269s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:45 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'} {{(pid=89145) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:45 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732280ef-1b65-483d-b4cc-8ef7899c1b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f29feee8-8acb-4f73-93c2-149286b431ab', 'volume_size': 1}' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498495ca-a98e-4e02-8626-98bff48a4cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:45 devstack cinder-volume[89145]: INFO cinder.volume.flows.manager.create_volume [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Volume volume-f29feee8-8acb-4f73-93c2-149286b431ab (f29feee8-8acb-4f73-93c2-149286b431ab): created successfully Jul 31 11:11:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498495ca-a98e-4e02-8626-98bff48a4cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89145) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:45 devstack cinder-volume[89145]: DEBUG cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Flow 'volume_create_manager' (c7fe9fd1-2e03-496d-ab0d-1b91f5f17cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89145) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:45 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-41302665-186c-416e-b58b-ce863315e7dd tempest-ProjectReaderTests-239160976 None] Created volume successfully. Jul 31 11:11:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Acquiring lock "cinder-f29feee8-8acb-4f73-93c2-149286b431ab-delete_volume" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Lock "cinder-f29feee8-8acb-4f73-93c2-149286b431ab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Acquiring lock "cinder-quobyte-f29feee8-8acb-4f73-93c2-149286b431ab" by "delete_volume" {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:46 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Lock "cinder-quobyte-f29feee8-8acb-4f73-93c2-149286b431ab" acquired by "delete_volume" :: waited 0.021s {{(pid=89145) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:46 devstack cinder-volume[89145]: DEBUG oslo.privsep.daemon [-] privsep: reply[6313eb3c-71db-4264-835e-2b7152bf40e1]: (4, 'qcow2') {{(pid=90199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:46 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f29feee8-8acb-4f73-93c2-149286b431ab {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:47 devstack sudo[110623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f29feee8-8acb-4f73-93c2-149286b431ab Jul 31 11:11:47 devstack sudo[110623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:47 devstack sudo[110623]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f29feee8-8acb-4f73-93c2-149286b431ab" returned: 0 in 0.374s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f29feee8-8acb-4f73-93c2-149286b431ab {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:47 devstack sudo[110631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f29feee8-8acb-4f73-93c2-149286b431ab Jul 31 11:11:47 devstack sudo[110631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:47 devstack sudo[110631]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1/volume-f29feee8-8acb-4f73-93c2-149286b431ab" returned: 0 in 0.251s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:47 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Lock "cinder-quobyte-f29feee8-8acb-4f73-93c2-149286b431ab" released by "delete_volume" :: held 0.673s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:47 devstack cinder-volume[89145]: DEBUG cinder.quota [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Created reservations ['6b177b14-fe50-467e-9544-4e78efd5a24b', '1ae700bd-e886-447c-bc1e-98dd2fe96de2', '3312910f-4a18-4ad9-9497-4302491d5969', '59d38dd8-6d5d-4be3-a72e-0df871e66c21'] {{(pid=89145) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445': None} {{(pid=89145) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:47 devstack cinder-volume[89145]: DEBUG cinder.volume.drivers.quobyte [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f0975e51-bba4-4171-9508-19e0b9968445'] {{(pid=89145) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.lockutils [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89145) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:47 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:47 devstack sudo[110634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1 Jul 31 11:11:47 devstack sudo[110634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:48 devstack sudo[110634]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:48 devstack cinder-volume[89145]: DEBUG oslo_concurrency.processutils [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9700136ec03e555c652b863a0ccd4ae1" returned: 0 in 0.265s {{(pid=89145) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:48 devstack cinder-volume[89145]: DEBUG cinder.manager [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Notifying Schedulers of capabilities ... {{(pid=89145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:48 devstack cinder-volume[89145]: INFO cinder.volume.manager [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Deleted volume successfully. Jul 31 11:11:48 devstack cinder-volume[89145]: DEBUG cinder.coordination [None req-6b6a84f5-d6e4-40aa-998d-5ca0dccc793c tempest-ProjectReaderTests-239160976 None] Lock "cinder-f29feee8-8acb-4f73-93c2-149286b431ab-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=89145) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:57 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=60,cinder:SELECT=41,cinder:INSERT=15,cinder:DELETE=3 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:11:58 devstack cinder-volume[89145]: DEBUG dbcounter [-] [89145] Writing DB stats cinder:UPDATE=58,cinder:SELECT=38,cinder:DELETE=7,cinder:INSERT=14 {{(pid=89145) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}